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CHAPTER 1 ' 

<. 

ERROR ANALYSIS 
AND PQUIRY _ ^ ^ 

Duriag the course of th« Adult Functional Reading Study, two 
'national surveys were^onducted . In the first survey, a national 
probability sample (N = 5.096) of adults aged 16 and over was asked . 
\o describe the kinds of reading performed in the course ^ ;°™^\ 
day. the amount of time spent in carrying out the reading described A 
and the importance attached to the various kinds of reading P^^f°™^- 
tfsuUs of this survey are published \n Be^Mng^tiyifies o A^e ^ic^ 
Adults (Sharon. 1972) and Appendix A of Mnlf 

-^^,\ 1973). In the second survey, a national probability sample 

N= 7.866) of adults aged 16 and over was asked to respond to 170 
readihg tasks representative of the kinds of,.reading reported in the 
reading activities survey. The 170 reading tasks were administered 
in 10 sets so that each adult responded to exactly 17 items. Results 
o? the second survey are reported in Adnlf Functional Reading Study 
(Murphy. 1973). 

' In the National Reading Performance .Survey, the survey adminis- 
trators read the directions for each reading task orally to the 
respondents. The respondents then indicated their "^P°"f ^^J^ , ^ 
underlining, circling, or placing an X on * portion of the stimulus 
:^terial ^..A in each reading task. The reading tasks 
istered in the comon multiple choice format. Because °f ^his type 
of administration, designed to correspond as closely " 
a natural setting in which one might encounter such reading tasks, it 
wa^ not possjble'to' perform the ordinary type of error analyss w th 
preconceive?distraaters listed as the only possible "sponses. In 
the materials used in the National Reading Perfotmance Survey, a 
great variety of responses was possible. In 'order to. analyze the 
Snds of errors made by respondents, a 10% .random sample o respondents 
was chosen and their responses examined in considerable detail. . 

Erroneous Responses • 

In order to examine erroneous responses in detail, and to com- 
• pare erron'rus responses within tasks and across tasks, -cj -espo«-' 

that had been coded as incorrect in the random sample was listed 
- ora master copy of the stimulus material for each reading task. 
In addition, the number of adults giving a particular incorrect 
response was listed. The number of distinct incorrect responses 
^aneed from as few as one. incorrect respbnse to as many as twenty- • 
se^S ' ^^e proportion of adults actudUy giving an incorrect r.esponse 
can be used" as a measure of the "importance" or "strength of that 
particular incorrect- response. 
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"Jo illustrate the kind of information that is available on * 
the 170 reading tasks used in the National Reading Performance 
Survey, the. results for five -tasks are given on the following pages. 
The error percentages reported are the percentages of the total num- 
ber of erroneous responses made on a particular item. Thus, they add 
up to 100%. It should be noted, however, that the numbers involved 
are small. In a 10% random sample, the number of respondents to 
any particular item is approximately 80. Therefore, the number 
giving incorrect responses is correspondingly small. For example, 
in the^summary for Book 1: Item 13, the number of persons involved 
is only 19. This should be kept in mirid in interpreting these* data. 
The difficulty level fro^ the national survey and the number of 
respondents in the 10% random sample are listed for each reading 
task. ^ , 

Illustrative Examples 
1. Bdok 4; Item 2 (Difficulty level = .999; Semplfe N » 77) 

a. Oral direction ; Place a circle around the bottle of 

liquid that would be safe to drink. 

b. Errors: NONE 



2. Book 1: Item 13 (Difficulty level .666; Sample N ^ 76) 

a. Oral direction : Look at the train schedules. Put a 

^ ^ * ' circle around the time the daily train 

leaving Trenton at 1:46 P.M. arrives 
in Washington. 

* 

b. Errors ; A - 42.1% 
. B - 5.3% 

^ C - 5.3% 

D - 5.3% 



3. Book 3: Item 1 .(Difficulty level « .957; Sample N ^ 77) 

a. '' Oral direction : . Put a circle around the label that 

would be the best one to put on a . 
box used to mail something -easily 
broken. ^ ^ 



E - 


15.8% 


F - 


10.5% 


G - 


5^3% 


H - 


5.3% 


I - 


5.3%'- 



b. Errors : -A - 50% < 
B - 50% 



4. Book 4; Item 9 (Difficulty level -814: Sample N 77), 

a. Oral direction ; Look at the garment tags. Circle the 
T" ' two tags that indicate the garments^ 

are made from 1001 Polyester; 



b. Errors: A - 35.7% D - 7.1% 

Br - 7.1% ^ E ' 21.3% 
C - 21.3% F - 7.1% 



= 5. Book 5: Item 3 (Difficulty l^vel ° .928; ^ple N ^ 77). ^ 

a. Or al direction ; Look at the application for; employment. 
Put an X in the space where you would 

write the name and address of someone 
^ ^ to notify in case of emergency. 

b. Errors; A - 40% C - 20% 

B - 20% D - 20% 

Analysis of Errors 

t 

The number of distinct errors on the 170 reading tasks 
ranged from as few as one to as many as 27. Approximately 900 T 
distinct errors have been identified and actually illustrated Jn a 
:master set of reading tasks delivered.to the National m^titut* of 
Education. Some errors. were ^made by as few as one person, .othets 
were made by as many as 15 of 20 persons. At least 
comnbn to 55 persons. No general hypotheses were f 
developing the materials. These are more or less complex readm 
ta^ks found in ordinary life, the empirical results give reasonable 
indications of the percentages of adults, and the 'percentages of 
aDDroximately 40 subgroups x)f adults, who can answer correctly 
Xple^estLns basfd on tLse materials The error -alysis . s 
an attempt to go futther - an attempt (1) to discover ttte kinds 
of errors made by respondents who can not answer these questions 
correctly and (2) to determine why particular errors are made. 

After the errors .identified in the 10% random sample of respond- 
• ents had all been listed on master copies of the reading tasks, an 
- attempt was made to categorize the kinds of errors' mad'e Several 
different classification schemes were tried. However, the great 
■vafie^rof errors that appears in this set of r-'^^^P^^^^^^^^"^ 
S defy-simple classification. It is possible to 'identify many 
errors that are questionable. That is to say. the open response . 
format allows respondents complete freedom in indicating their 
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ARNEl?is a licensed trademark 
which can be used to identify 
Celanese TnacetSffe Fibers only 
in fabrics of proven performance- 
Celanese laboratories continusrtly ^ 
evaluate fabrics'of the same style 
as ID' this garment against rigorous 
performance standards. If the fab- 
ric styles fail to meet these stan- 
dards, the Triacetate fibers cannot 
be identifiejl as ARNEL- . 



100% ARNEt?TRlACETATE 



IViBchine^ash - gentle cycle - . 
warm water. ^ 

•Tumble dry, warm Betting. 
•Steam iron at medium setting. 

• Wash dark colors or prints' 
-separately. 

• Waffh pleated garmets by hand - 
drip-dry - ioiKX wrmg. 



100% TEXTURED POLYESTER 

•Machine Wash and Dr^-^Wash and wear cycle 
•WiU Not Shrink or a^ret'cl:^ , • * 
•'Wrmfcle Resistant' ^ • ^ 

•MEEDS m IRONING ^ 
•DO NOT DRY CLEAN 
PALISADE KNITTING JvilLLS.'GUTTENBERG, N.J 
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WASHING INSTRUCTIONS 

-Wash by macjiinaat low temperature 
by machipe at low temperature or hang on 
linCt If ironing is desired, use cool iron only 

ADVANTAGES. ' - 

1. .Smooth comfort.' ideal for outerwear or^ 
. next to skin. 

2. Excellent dimensional etability.^ 

3. Delightful warmth wUK light weight. 

4. Easy-care, excellent washability.' 

5. Mothproof and mildfewproof. 

The irregularities and 'variations in the 
weave of this fabric are characteristics 
of thi^ fa))ric and are in jfio way 
to be cdhsidered as defects,* 



ERIC 



/ ■ 



J -12- 



Book 5i Item 3 



( 




APPucTno^^ 



pATE 



HMOOLCI 



<MAI0CNI 



LOCAL^DDRESS 



TELEPHONE NO. 
ZIP COPE 



PERMANENT APbRESS X ( C 

$iNOLe G 



HEIGHT^ 



WEIGHT 




■ -13- 



\ 



responses: As a result, there is a sizable group of -"^^ ^^at . 
can be usefully classified as inclusive Errors. The portion of the 
stLulus material underlined or. circfed does in fact contain the 
cWct information, but so much additional information is included 
t^^t L, response wis judged to be .incorrect. f ^^^^^^^^^^^ , 
ioVtion circled or underlined included an alternative response 
tSIt was clearly incorrect, it seems^ clear^o consider the response 
I^in^orrec^ In cases where the additional °' " 

underlined is not relevant to the correct '^^f?""^^' J;^„^',^^°^^„ect ' 
difficult to determine that the Respondent did not know th^ n^rections 

Lwever. to keep a proper perspective, this kind of error accounts 
for less than 10% of the total number errors. ^ 

A second class of errors can be identified, though the. decision 
that a particular erroneous resp6nse belongs in this category is 
somewhat arbitrary. These responses '° ' 

do not include, what the item developer consideredto be the cor 
reot response.-- For example.' a question ^sks the<^e^pondent to 
circle 'the telephone number that should be called under certain 

entcircles the person or place whiqh i^ uniquely connected with the 
correct telephone number. Although the directions were followed 
explicitly., the respondent probably does understand the question and 
probably would dial the correct telephone nu*ber in a slinulation 
of this activity. However, to <,nce again attain;a proper perspective, 
this kirfd of response, based- on the judgments of^the project statt. 
Occurred in only about 5% of the erroneous responses. 

By and large, more than 85^ of the erroneous responses appear 
' to be clearly and unambiguously incorrect. Without actually inter- 
viewing the respondents. to ascertain what they were thinking i is 
-difficult to categorize these responses. However, in an attempt to 
understand why adults give particular erroneous responses on the 
real life reading tasks, we asked a froup of adults to volunteer 
to respond to the materials and then ^iscuss . their responses with 
two members of the prbject staff. 

Error Inquiry - - 

Two adult learning centers in New York State agreed to par- 
ticipate in this'ptiase of the study. Approximately 100 adults 
were asked to respond to the materials which were group administered 
to small classes by the: project staff. All of the students who 
participated volunteered to do so and were all adults over 16, male 
and female, and white, black.. .Spanish, or -Oriental. The same 10 



test -booklets of 17 items each were used in the -Learning Centers • 
that had been administered in the" National Reading Performance 
Survey. However, the .question for each reading task appeared 
above the stimulus and was r.ead silently by the - respondents. • 
There was no "time limitf to the test administration and mo^t of . . 
the students completed tfie materials within 30' minutes. The ^ ^ 
reading item booklets were scored ijnmedlately. and egch respondent 
was interviewed individually by a i*oj^ct stafi member as soon , 
after taking the test as possible. In addition to an overall 
discussion of the materials in general, the students were aSked 
to elaborate on their answer^ to t^ reading items. They wer* 
asked to explain why they answered as they did. if possible. 
The length of the interviews varied. In some cases, the inter- 
view lasted more than an hour because of^^ie respondent s interest 
and involvement in the reading items. *./ ' 

Two very simple causes of incorrect responses emerged. • Many • 
persons simply do not understand the words in the reading tasks, 
and, when they do understahd 'the irklividual words^ they do not 
understand how to extract information from the forni^ in which these 
words are patterned. Patterns do not refer to the patterns of 
sentences and paragraphs, but rather to the patterns of forms, 
tables, and charts that are so commonly usedlin such everyday things 
as bills and scheflules. This is a paisimoniOus explanation of lack 
of success in ha ndling common reading- tasks/j M any poor readers _ — 
are simply confus ed by suctf wordSL and phrased" as "to call up," 
"transplant," "appard," "(Commencement,", "lilies," "toll," "injection, 
'^'series," "creed," "misstatement of fapt," "confronts," "recipe," 
"ingredients," "lever," "firearms," "locker," "escape," "extinguisher, 
"ingestion," "correspondent ,". "tb fill in," "came together," "per- 
manent," "pesticide," "circle," ''fourth," "to operate," "classified, 
"fuel," "stance," "minimum,*', "severe," "mild," "whom," and "experience 
These 'are words included in the everyday reading tasks used in the 
study. ^ 

In addition, many persons who do have a sufficient vocabulary 
to understand the words included in the reading task»-do not under- 
stand how to handle simple, words, phrases,, and numbers when they 
are presented in rows and colurfins as in doctor's bills, telephone 
bills, train schedules, guides, report cards, application forms, 
election ballots, employment benefit forms, income tax forms, 
social security forms, and traffic ticket*. Many respondents are 
simply confused by such materials, ani, in many instances, responses 
are simply guesses and "rtot the result of an intricate process which 
leads to an explainatfle response as an alternate to a correct one. 



m some few instances, a particular incorrect response is connnon 
to a sizable group «f persons and a reasonable explanation can be ^ ^ 
given foT the response. For example, in the illustrative example. 
Book 1: Item 13 j note that the' incorrect response lettered A was 
given by about half the respondents who responded incorrectly. In the 
-error- inquiry, respondents understood' the >6rds "arrive" and"Washingto 
but did not understand how to use the tj?^in- schedule ; The 7:50 A.M. 
response' Was the response just below those two. words on tht page. 

• % Maiw responses do not appear to be amenable to explanation. 
In fact-,\in the error inquiry, we discovered that reasons for 
particular responses to the reading tasks could be quite unique 
to the individual respondent. A few of these are given below. 

' * 

xii a list in which the respondent was to choose an entry- 
Corresponding to baby's clothes, t,he entry hampers appeared. 

respondent who chose that entry explained that he thought 
hampers might be like ''Pampers" — a commercial product 
^f, diBposafile baby's diapers. . 

2 A list contained several amounts of alcohol and the. effects 
associated with drinking such amounts.. A re^ondent was 

\ - g fiTrH ro -'^-^^ ;imnnnr -^sfioriarpd with a given 

He circled a greater amount and gave as the reason his 
disagreement with the chart. -He judged that the effect^ 
would be associated with a greater amount of alcohol; 

3. A doctor's bill listed the amount owed. >A respondent 
circled ^ higher amount listed elsewhere pn the bill be- 
cause it (Jorresponded more closely to hej^ own latest 
doctor's bill. • ^ 

Discu3sion of Results ' ^ 

There appear to be two ways of considering these results. The 
vocabulary and formats enfployed in everyday reading materials . are 
fixed and, therefore, children and young adults should learn, perhaps 
while still in school, to understand such vocabulary and formats. 
There is evidence that educators are moving in this direction in 
attempting to alert schools to these problems and to develop material 
^for u&e in the schools for teaching this vocabulary and these skills. 
I However, the infonnation may also be considered in reference to the 
common, everydays^^ading materials themselves. In developing such 
materials, producers may be encouraged to use simpler vocabulary 
and simpler formats. /A large and complex table can certainly 



summarize a gre^ deal of information. However, if such tables 
are difficult to understa*! for sizable groups of people, the 
saving in space may be of questionable benefit. Votirfg ^f orms, t?x 
■ foris doctor's bills, guides, ^d schedules of all tyP- - per- 
haps bee simplified by expanding the materials if the benefit in 
comprehension is evident. ^ • . 

A final point shciuld b6 made about the; actual directions 
employed in administering the reading tasks in ^^^^ -^^-f^/,",!;;^^- 
The words and phrases identified in the reading tasks as difficult 
for some adulfcs wete also used in the directions Since the intent 
of the questS^iias to find out if the respondent could read he 
stimulus materialAthe questions should have been phrased in the 
simplest language. ^ AS a result of the error J^/^J^^^ , 

error inquiry, a number of suggestions for re-phrasing he oral 
directions can be made for any possible further use of these 
fcaterials. A set of alternative directions for some of the reading 
^fs^s hi: been deposited with NIE. Finally ^^^^ l^^^Tus^ 
of some of the reading tasks has become evident from the Results 
of t" error anafysis'and inquiry. A list of such tasks is also 
on file at NIE. • . . 




CHAPTER 2 - ' - 
RELATIONSrflP DF DECODING TO ADULT FUNCTIONAL READING- ' '^^ 



In this task, a^ subset of the adult functional reading itema from 
the National Reading Surve/^yas atiministered to a Vo^p of approximately 
eighty adults together with'V-set of materials designed to assess decod- 
ing skills. The purpose of the task is to examine wh)pther or not the' 
inability to answer correctly the adult reading tasks is attributable to 
inadequate decoding skills. 



PREPARATION AND ORGANIZATION FOR THE STUDY 
'Die Advl;3ory Committee 

Since the term "de^oding^^is conceptualized differently by various 
people, the firs^ step undertaken by tbe investigators was to convene an 
advisory coraiilttee ^f specialists in.reading with the objective of defining 
"decoding" for the purposes of thia study. Further, it was expected that 

the ad visory committee would assist -in det ^^^fii nR decoding should be 

tested in adult subjects. 

The^i^tihg was held June 29 - 30, 1974 at Educational Testing 
Service (ETS) in Princeton,' New Jersey.^ The advisory committee consisted 
of: 

L|a E. Aaron, University of Georgia 

jlme Algozzine, New York State Department of Education 
Oon A. Brown, University ^of Northern Colorado 
Jeanne Chall, Harvard University ' ' 

Lynette Gaines, University oi South Alabama 
.Barbara Palmer, Universit^f of Connecticut 



John B. Carr9ll, then of ETS and currently at the University of North 
Carolina, also attended the meeting in a consuj-t^tive 'jrole.' Committee 
members were selected from a substantial list of cand^ates and selection 
was based on the aim of obtaining committee members wfe were familiar 
with and understood the problems of adult literacy. . fcrther, every 
attempt was made to have the comnittee membership reflect as much as 
pdfesible the wide range of viewpoints that exist in t% field of -reading. 

First, the cotmnittee as a whole ol>jected to the loose use of the « 
term "decoding" and felt that, for purpOses'of the task at hand, word 
attack skills was a more appropriate concept from and with which to work. 
The committ^ then focused on identifying the different elements involved 



in decoding and? specifically those elements rela.ted to assessing the 
ability of adults to*' decode. Five "guide question-s" were proposed as 
an aid to the di|jji||ittee's discussion: 

1, ) Is decoding a problem in ;,the performance of adults 

{^he 170 tasks in the National Reading Pet formance Survey? 

2. ) If so, what elements present major decoding problems? 

< -3.) What are the characteristics of these elements and can 

^ they be classified? 

4. ) »Can these be ordered sequentially and, if so,, on what basis? 

5, ) Is there a test or can one be generated to determine where 

adults fall out on this(theSe) sequence(s)? 

The conmittee considered the possibility of using existing tests 
and test specifications appropriate for the adult level either as the 
actii^l instruments for providing information or as guidelines to aid 
in the development of a new test bn-word attack skills. Some materials 
and test copies tad been gathered from the ETS Test Collection^ for the 
^purpose of providing the committee with resources should they wish to 
review materials. In discussion, the committee felt that th^^existing 
decoding tepts, while partially ad~equate, could not meet all of the needs 
-of the present study. 

Jt was decidec?\hat, while the conmittee could borrow ideas from 
existing tests, a complete list of specifications should be drawn up and 
a new test designed to incorporate these. The initial list of areas to- 
be considered in(tluded: visual dis crimination: r^uditorv fii srri ml nat i nn i ^ 



Ly c: v,Lj>m.i.<a^i»»-<«* ^ — — ■ 

basic si^ht vocabulary; phoneme-grapheme correspondence for initial con- 
sonants, ending consonants, short vowels, long vowels, diphthongs, and 
digraphs; context clues; structural analysis; syllabicaticm; blendir^g. ' 
The formulation of this list led the committee to disaiss%*ie>f h how t\je_^ 
list could be used in the development of specifications and how the areas 
listed could be used to provide valid information. 

The committee felt that prei^equisite to^ any testing for determining 
adult literacy would be to find out if the. adult could identify letters 
oi the alphabet. This ability could be tested by having the adult point 
out to the examiner specified letters, match letters to sounds said by % 
the examiner, and so on. Recqgnition of both upper and lower case lett*s 
in 'printed form should be required. ^ 

The committee also felt that, to further determine whether adults ^ 
could decode, a series of graded paragraphs should be used. These par^- 
• graph's would be used in a one-to-one testing situation and the adult 
would read them orally at sight. The adults could read the various 
paragraphs until errors were so excessive as to preclude any comprehension 
of content, i. e. , until the adults reached their frustration level. After 
this point, the examiner might just ask if the adult fould read any of the 
words from the higher level paragraph(s) . 

Each of the ^'hierarchical" paFagraphs to be used in ,the decoding test 
would have accompanying 'exercises based on the word attack skills needed 
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tb read that passage. The committee listed word attack skills essential 
tb mastery of decoding in a hierarchi^l form for this purpose. Specific, 
instructions as to which elements wotAd be tested along with each para- 
graph and how they should be. tested jfrere provided. However^ the committee 
felt that successful oral reading of the paragraphs would indicate -that 
the adult has the ability to decode^. , In this way, it was felt that; con- 
current validity would be established. 

The sequence of oral sightrriading materials was to consist of a 
minimum of three paragraphs, the/first of which would appr#ximate the 
upper first-grade level and havrf accompanying questions checking the . 
lowest level of word- attack skills, such as visual and auditory discrim- 
ination. The second paragraph A/ould approximate the upper second-grade 
or early third-grade * level an<y the, accompanyingj skills questions would 
cover such things as initial alnd ending consonant sounds-symbols, long 
and, short vowel sounds-symboli, and diphthongs. The third paragraph 
would approximate middle pr Jpper fourth-grade difficulty and the 
accompanying skills questionfe would cover such things as blending, 
syllabication, and some uppir level structural analysis skills. Such 
things as basic sight vocab/ulary and use of context clues would cut 
across all levels of paragraphs. 

The committee indic/ted that if an adult, could, successfully read 
at Signt the three gradeTd paragraphs and do most of the word attack 
skills incorporated in them, he could be said to have no majo^decoding 
pr o blems. — Tlte aJulL j.) f iuulJ lIibu be given iJlial would be L uublJet,^J a 
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fifth- or sixth-grade/level passage to sight read orally. This ^Jassage 
would be taken from yhe 170 tasks developed for the Natior^l Reading 
Survey. 

Suggestions for scoring the oral reading of the various paragraphs 
were also provided. The final specifications for the decoding instru- 
ment as well as the test administration procedures are contained in the 
Appendix for this chapter. 

If an adult' should' still experience problems* with reading after 
scores on the decoding tests indicated a mastery of decoding skills, it 
was suggested that an appropriate standardized diagnostic reading test 
be given to determine what other kinds of difficulties «e adult might 
have that made him unable to read adequately. 

Before the advisory committee meeting adjourned, the conmittee 
members made it clear that,-^ proposed instrument for this study was 
to be a research instrument .'^ It was felt that an instrument similar * - 

to the one proposed-was needed in the field but that a thorough investi- ^ 
gation of the entire area of assessing decoding. in adults was needed 
before a final instrument should be developed. 'The proposed decoding ^ 
measure would be only a first step in the direction of meeting an 
existing need. 
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Instrument Development aad Preparatlgn ^ 

Following the advisory committee meeting, ^the development of the 
decoding instrument was undertaken. All test questions, paragraphs* 
to be read orally, and test administration procedures were written , 
and reviewed by ETS staff with experte^ in the field of reading assess- 
ment.' Materials and suggestions contributed by several committee members 
provided the bases for the materials written. Each item and paragraph, 
along with the administration procedures foj^the same, were reviewed by - 
three staff members other than the writer"/ Further, the ETS editors 
reviewed the material^ for clarity of expression, to eliminate any existing 
ambiguities) and so on. ' ; 

In addition to the decoding instrument, 33 functional reading tasks 
were selected from the 170 administered in the National Reading Purvey. 
These 33 tasks were prepared in the form of a reading test, the results ^ 
of which would be compared to the results of achievement on the decoding 
instrumertt. . 



, DESCRIPTION OF THE INSTRUMENTS USED 
The Sorvey of Reading Materials 

Distriment? Description . A subset «f the 170 reading tasks from 
fhP Npfinn^i R^^H^n^ Snrvpv wag rh^spn ^nd fighlnnofi into a tcct coti 
mated to jequire about an hour of respondent time. An attempt was made 
to select the least and^iguous items on the basis of the error analysis 
and error inquiry. In addition, items that employed in the directions 
exact words appearing in the stimulus materials were not used. The 
rationale here was to prevent sin5)le matching of words and to further 
justify using printed directions to facilitate group administration 
of the materials. Furthermore, an attempt was made to approximate 
the distribution of item difficulties and kinds of forms and benefits 
present in the national survey. The dfstribution of items by difficulty 
and descriptors is given in Table 2,1. 
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Table 2.1 
DESCRIPTIONS OF READING TASKS 



Difficulty 
Level . 


# 9f 
Items 


. Form 


# of 
Items 


# of . 

Benefit Items 


90-100 


13 


Book 


1 


Economic - 6 


80-89 


8 


Periodical 


2 * 


Occupational 2 




1 


Legal Document 


3 


Education/Culture 3 




L. 


Li -1. 9 L Xll^ 


5 


Recreation 3. 


50-59 


1 


Insftuctio^ 


6 : 


• Health 6 


40-49 


• 2 


Advertising 


• 4 


Maintenance ^ 3 
-\. 






Form 


2 


Personal 

Relationships 4 






Personal 

Communication 


5^ 


Citizenship 6 






Miscellaneous 


5 





In all, 33 reading tasks were incorporated into an experimental test 
of functional reading. As in the national survey, respondents had to 
indicate their answers by underlining, circling, or placing an X on a 
portion of the stimulqs material. .There was no fixed time limit; each 
respondent was to*be able to proceed at his own rate. The test could 
be either individually or group administered. 

Scoring , .The reading tasks were scored right, wrong, or omit 
using the coding specifications developed for coding the national 
survey materials. The coding was performed by the director of the 
coding phase of the national survey. The project director checked 
20Z of the materials for quality control. The scores were then coded 
on a machine scorable answer sheet for analysis. 
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The Decoding Instrument < » . 

Ins'Kuinent Description . The decoding instrument developed 
reflects t^ specifications provided by the advisory committee. 
Three t^^tfS^o of vhich have been divided .into sections, made up 
the decoding ih&^rument. Table 2.2 provides a summarized description 
of the decoding instrument. 



Table 2.2 



DESCRIPTION OF THE DECODING INSTRUMENT 



Test 



Alphabet test - 



Test of Word Attack 
Skills 

Level A 



Levej^ 



Level C 



lest, of Oral Reading 



Number 

of 
Items* 



26 

66 
13 

32 

21 



Item Type 



4- to 8-choice 
multiples-choice 



(See .Below) 

2- to 6-c^oice 
multiple-choice 



r 3- and*4-choice 
multiple-choice 

5- and 4-choice 
multiple-choice 
plus one 1-word 
written response 
and one oral reading 
of three wrods** 

Passage reading orally 



Note: *The total score on e^^ch t;est equaled the number of 
items correct. 

**The oral reading of two words was administered with 
the Test of Oral R/feading due to the nature of the 
item. 
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For the Alphabet Test , each subject had a test booklet in which , 
to respond. Each of the 26 items consisted of a row of four to .eight 
letters. A mixture of upper- apd low?tr-case letters was used for each 
item. The test administjatot said one of the letters in the row- and 
the subject was to put an X on that letter. The letter was said only 
once unless conditions were such that it was difficult for the subjects 
to hear what was. said and, ttien, the letter was repeated. There was 
no fixed' time limit. 

Each subject had a test booklet in which to respond to items in 
the Test of Word Attack Skills , the exception being the one item that , 
was ^H,.-fo-.cfprpH w-lfh rhe Test of Oral Reading . The test had ^ . 

time limit. To the extfent. possible, every subject was given sufficient 
time to attempt every item.. • 

The Test 6t Word Attack Skills had three sections, each one 
representing one of the three levels (A - C) specified by the advisory 
committee. Level A cottsisted of 13 items divided into four sets, each 
of which was to measure a specified area and was preceded by an example. 
The first, second and fourth set of items, each had thr.ee items and were 
intended to measure auditory discrimination, visual discrimination -and 
the use of context clues respectively. The third set contained four 
Items and was intended to measure recognition. of basic sight vocabulary. 
Tb6 Administrator's Manual specified requiied procedures for each item. 

i " 
■ '•"\e» «. l D LuaslsLLd o f iLems Jiuid u J luu. TJ., r„Lb tiadi uf wliich - 
was preceded by one or two examples. The first set contained five items, 
four to measure recognition of inltia^ consonant sounds-symbols; one 
for measuring recognition of digraphs occurring in the initial position. 
The second set contained five items: four to measure recognition ot 
final consonant sounds-symbols; one to measure recognition of digraphs 
occuring in the final position. The third set containing 12 items was 
to measure recognition of short and long vowel sounds-symbols as well as 
retognition of diphthong' and digraph sounds-symbols. The fourth^ set, with 
four items, was intended to measure the use of context clues. The tilth 
set had six items to measure the use of structural analysis. For all 
but the fourth set of items, the Administrator's Manual specified required 
procedures for each item. The directions were given, the example (s) done 
and the subjects proceeded to work on their 6wn for the fourth set of items 

Level C consisted of six sets of items, five of which fi"f ^ 
total of 20 item^ and were in the test booklet labeled Test °f Wor^ . 
Atta ck Skills. The last set contained ,^nly one item and was administered 
^ith rhP Te^of Oral Reading due to the nature qf the item, tach set 
of items except the first was preceded by an exataple. The first set 
contained five items and was similar to the last set in Level B in that 
the purpose of the set was to measure the use of structural analysis, 
however, the Level C items were intended to be more ficult. No 
'•'example was needed since similar items had preceded this set. The second, 
' set contained five items for 'measuring recognition of digraphs. The 
third set, consisting of fouV iUfs, was intended to measure the uSe of 
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context clues. The fourth and fifth sets, eacli containing three items, 
were to measure syllabication and blending syllables, respectively .For 
the krst and fifth sets .of itenis- the Adminis-tpator's Manual specific^ 
required procedures for each item, but directicijis were given, the 
examples done and the 'subjects proceeded to work pn their own, for /he 
remaining sets of items. For the Test of Word Attack Skills, Table 2.3. 
indicates for each level: the specification area tested, the number of 
items per area, and . the item numbers as they occur in the test booklet. - 



; Table 2.3 

•DESCRIPT?IO'N OF THE TEST OF WORD ATTACK SKILLS . 



Level Specification Area 



Number of 
Items Per 
Area 



Item • 
Numbers 



Auditory discrimination 
Visual discrimination • ^ 
Recognition of basic sight words 
Use of context clues 

4 

Recognition of initial 'consonagt sounds 



Recognition of final consonant sounds 
Recognition of short vowel sounds 

Recognition of long vowel sou,rui^ 

Recognition of diphthongs 

Recognition of digraphs - both vowel 
and consonant 

Use of context cjues 

Use- of structural analysis 

Use of structural analysis 
Recognition of' digraphs - all 
Use of/context clues 
Syllabication 
Blending syllables 



3 
3 
4 

3/ 



4 
5 



2 
6 

4 
6 

5 
5 
4 
3 
3 



I- 3 

.4-6 . 
'7-10 

II- 13 

14-17. 



19-22 

2<»,26,28 
31,33*^ 

2^,27 ,29* 
30*, 35* 

32,34 

18,23^29 
30,33,35 

36-39 

40-45 

46-50 
51-55 
56-59 
60-62 
63-65 



*Ite^s indicated overlap with recognition of digraphs, 



The booklet labeled Test Of Oral Reading contained three parts. 
The first part consisted of one item for which th6 subject was asked 
to orally read, at sight, three words that were divided into syllables. 
This item was to measure blending syllables and was classified as the 
. sixth set of Level C of the Test of Word Attack Skills . The remainder 
of the^oklet was the Test of Oral Reading that included four passages 
to be read aloud, at sight. First, -there was a part containing thi.ee 
passages, each one representing one of the three levels (A -'C) and 
.reflecting the skills specified for that level in the hierarchy indi- 
cated by the advisory committee. The -three passages were fol^wed by 
a fourth passage that was taken from one of the 170 tasks in^ie 
National Reading Performance Survey. The f&ur passages in the 
Test of Oral Reading were intended to be of increasjlng difficulty 
:from4:he first through the f'ourth. The readability of each passage 
was determined by using two formulas (Dale and Chall, 1948; Gray and 
Leary, 1935). The results showed that each passage written and the 
one from the .National Reading Survey approximated the level they were ^ 
intended to be per the advisory committee's recommendations* 

All three tests in 'the decoding instrvinent are appropriate for 
individual aciministration. Both the Alphabet Test and the Test of Word 
Attack Skills can be group administered but the Test of Oral Reading 
\ must be individually administered. 

Scoring . Each item was scored on a pass or fail basis. Jhat 
if a subject's response was correct, he received a "pass on the item. . 
•If his response was incorrect or he made no response, the subject re- 
' ce'ived a "fail" on the item. Every subject had an opportunity to try 
every item in all three tests of tlhe^ decoding instrument. . 

Using test keys indicating the' one correct ahswer. four scorers 
scored the subjects' Alphabet Test and the Test of Word Attack Skills. 
For quality control of scoring, one-hBlf of the test booklets, randomly 
selected, were scored by two independent scorers and there appeared tCK 
be no problems|Ln scoring. ' The score for each item was coded on a 
machine scnrab*e answer sheet. 

Scoring for tffWoral items was done -whe\i the items were administered. 
There were four test, adminis.trators who gave and simultaneously scored, 
the items. Prior to' the testing sessio'ns,^ the test administrator^ were 
' trained and" discussed any questions regarding the f '"^^'^^J"'^^"" 
the scoring procedAes. D«e to the nature of the items it was difficult 
to determine inter scorer reliabilities; however, every indication was . 
• • 'that (^he scoring was consistent across scorers. Standard S^^^f 

for scoring the oral items were in the Administrator's Manual and followed 
by each administrator. 

» The item classified with the Test of Word Attack Skills and intended 
to measure blending syllables was to be scored using the following guide- 
lines: - ' 
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Ho errors are allowed. All three words fliust be read correctly. 
ERRORS include: 

Omitting a part of the^word. 

Replacing ^cortect ^'sounds-symbols" with incorrect 

"sounds-symbols" . 
Addlng^ "sounds-symbols" not present in the words. 
Changing the position of "sounds-symbols** to incorrect 

positions in the words. . 
Mispronouncing the word. In the words "innocent" ^ 

and "ne\^stand/^the last letter may be dropped due 
' . to dialect. Do not count this as an error. 

NOT ERRORS are such things as: 

Repeating the word or parts as in stuttering. 
Pausing before reading the word or syllable. 

The first* three passages in the Test of Oral Reading were scored 
PS follows: 

Scoring Criteria 

Passage for Level A - one error only is allowed 
Passage for L^vel B - one error only is allowed* 
Passage for Level C -two errors only are allowed 

ERRORS include: 

Omitting a word except a word or article (e.g., a, the ) 

that appears more than once. 
Substituting another word for the one there. 
Adding a word or words that are not there. 
Changing the position of w^rds (e.g. , is it for it is ) . 
Mispronouncing sight words or words that follow regular 
rules of pronunciation. Words not following rules 
are in passage B: "listen" 
in passage C: "weather" 
Asking for aid in pronouncing a word that the subject 
tried and could not get. 
NOT ERRORS are such things as: ^ 
Repeating words read. 

Pausing briefly between words or sentences. 
Ignoring punctuatiqtp marks in reading orally. 

The scoring of the fourth passage involved the following guidelines: 

Scoring Criteria 

Only two errors are allowed. 

ERRORS include: 

Omitting a word except a word ipr article (e.g., a, the) 

that appears more than once. 
Substituting another word for the one there. 
Adding a word or words not there. 

Changing the position of words (e.g. , is it for it is) . . 
Mispronouncing words unless corrected immediately 
following mispronunciation. 



Asking for aid in pronouncing a word that therratbjfect 
tried and could not- get. - * ^ 

NOT ERRORS are such things as: • 
Repeating words read. 

Pausing briefly between words or sentences. 
Ignoring punctuation marks in reading orally. 



TEST AIMINISTRATION 



The Sample ^' . , ^ 

The sample consisted of 77 adults enrolled in courses at* an a4ult 
learning center. The learning center is housed iti an 'old elementary 
school building, which is very well kept. There is a. reading laboratory 
which has a specialist teacher supervising classes as the students use 
the facilities. 

In-order to get^^tudents to react freely and without stress during 
the testing sessions, it was decided not to obtain any personal infoi^- 
mation on th0 students. In this way, they would not feel threatened by 
thinking that their personal test results or information would be kept 
on record and used by others without their permission. However, it was 
noted that approximately one-third of the subjects were male, the female' 
students being in the majority. In addition, the guidance counselors 
indicated that the classes were considered to be in self-contained class- 
rooms except for the time spent in the reading laboratory. That is, 
except for the time spent in the reading laboratory, the subjects generally 
had only one teacher for all pf their studies unless they attended classes 
for a whole day. .If. an adult attended classes all day, the teacher in 
the afternoon session wds ';iot the same as in the morning session since 
each teacher was assigned tiQ teach for only a half-day. The subjects were 
drawn, in approximately the percentages indicated, from the following 
types of classes' (as categorized by the guidance counselors): 

8% , Advanced 'Level of English as a Second Language ^ 
34% Students Achieving in Reading at the Primary-Grade Level 
28% Students Achieving in Reading at the- Intermediate-Grade Level 
28% Students Achieving ifi Reading at the Pre-G. E. D. (High 
School Equivalency) Level 

Given these classifications, it w>s hoped that the sample would range 
from very low-level readers to readeri who would be considered quite lit- 
erate. In other words, in order to satisfy the purpose of this study, an 
effort was made to obtain a sample with a wide range of decoding ability, 
including subjects with both m^jor decoding problems and those who would 
be considered as having no major decoding problems. 



Procedures in Administration 

For purposes of this study, the Survey of Reading Materials , . the 
Alphabet Tegt ,^ and the Test of Word Attack Skills were group administered. 
The Test of -Qral Reading was individually administered. The group admin- 
istered 'tests were given at two ses^ons, each on a separate day, as 
follows: 

Session 1 AJjA^bet Test 

j^Day 1) Test ot Word Attack Skills 

Session 2 Survey of Realfcngr,Hat%rials 

(Day 2) ' ' 

For those absent on the days their class took the tests ^above, two 
other days for make-up of missed tests were scheduled. These make-up^ 
sessions were small group administratiems with a few individual adminis- 
trations where necessary due to student schedules. ^ 

Individual administration ofe the Test of Oral Reading covered a 
period o^ *two days for four test administrators. 

Before all testing sessions, both for t^e group and ir^dividually 
administered tests, the subjects were told that they should not* become 
discouraged by any. test questions. To avoid frustrating them, the 
subjects were told that not everyone was expected to be able to dc all 
the questions although everyone was to have a chance to try to do every 
question in the test booklets. Also, it was made clear that in no way 
would the tests be used for grading them or would the test results go 
on their records. No time limits were set for any tests. Each subject 
proceeded at his own 'rate. As might be expected, some classes/individuals 
needed more time to go through the test booklets than did other classes/ 
individuals . 



RESULTS 



Statistical Properties of the instruments 

f 

The Survey of Reading Materials . The difficulty levels on the 33 
reading tasks ranged from .33 to .97. The mean difficulty level for the 
entire test was .68. The mean difficulty level for this, set of items 
in the national survey was .81. However, the percentage of non-responses 
on most of the items is considerably higher than the percentages in the 
national survey. In this sample, the percentages of non-responses ranges 
from 1% on item 1 to 48% on item 33. The average percent is 20%. In the 
national survey, the percent of non-responses on these items ranged from 
0 to 17%. The average percent omitted was only 4%. The. difference .in 
non-response between the national sample and the sample for this study 



may b^jdue to ihe-^fact that the directions, which were read orally to 
the responde^s lit the national survey, were not read orally to the 
respondents/in this study. In the national survey it may have been 
difficult /for. a. respondent not to attempt some response in the presenc 
of the syftvey administrator* 

F(/r .this study, the adults were given as much time as desired to 
complete the materials. The percent. passing an item is based on the 
entiyfe sample with no adjustments for omits. An omitted response is 
ther/fefore interpreted as meaikng that the respondent was not able to 
•respond correctly. In some instances, he or she respgnded incorrectly. 
In/^ther instances, he or she simply di€ not respond at all. However, 
fo^ completenesa, the percent of non-responses is given in Table 2.4. 
a/ong with the percent passing and the r-biserials of. the items. The 
s^orfes on the total test ranged from a low of ^ to a high of 33. The 
idean score was 19.9 (S.D.=8.7). The reliability of the test using the 
,kuder-Bichardson Formula 20 (KuderrRichardson, l937). is .94. 



Table 2.4 

* ITEM ANALYSES FOR THE SURVEY OF READING MA^plALS 



i 

Item No. 


% Correct 


% '•Non-reeponse 


41 

r-biserials 


1 


97 


1 


A 


2 


90 


5 


0.65 . ' 


3 


97 


4 


* 


4 ' 


86 


7 


0.56 


- 5 


'89 


5 . 


0.74 


6 


85 


4 


0.73 


7 


77 


8' 


0,74 t 


8 


86 


9 


0.63 


9 


59 


4 


0.69 


10 


63 


15 


0.58 


11 


89 


7 


0.53 


12 


60 


4 


1 0.68 


13 


90 


7/ 


0.70 


14 


56 


17/ "'v 


0.61 


15 


81 


8 


0.45 , 


16 


I 70 


9 


0.37 


17 


59 


''12 


0.4^ 


18 


N?0 


. 15 


0.57 


19 




19 


0.60 


20 


57/- / 


31 ' 


0.68 


21 


59V 


23 


0..47 


22 


79 ] ^ 


17 


0.37 


23 




31 


0.68 


24 


' . 79 


28 


0.58 


25 


- — I 

51 


37 


0.62' 


26 


65 


36 


0.66 

1 ■■ 


27. 


61 


37 


0.71 


28 


54 . 


39. 


0/65 ♦ 


29 


33 


36 


0.63 


. 30 


4a 


33 


0.55 


31 


48 


45 


0.70 


32 


54 


47 


0.64 


33 


49 


48 


0.38 




— : • 



*The .r-biserial was greater th^n 1 due . to lack of normality in the dichotomi?ed 
variable and the inexact nature of tltf estimation procedure. 



•31- 



The Alp habet Test . This test proved to be a very easy test for this 
samp le. 801 getting al l 26 items correct. Another 12% had a total score of 
25. The lowest score was 22, obtained by only two people in the sample. 

Reliability Jit the Alphabet Test was determined to be .53 using the 
Kuder^Richardson Formula 20 (Kuder-Richardson. 1937) based on the internal 
consistency of all the items in the test. However, this figure does not 
adequately explain the data *ince between 95 and 100 percent of the sample 
passed all but three items, and more than 902 of the sample passed these 
three. The lack of variability in performance of the sample led to the low 
reliability calculated; this is not to say that the test was not a good 
measure of knowledge of the alphabet. In other words, little information 
could be obtained from the results of this test other than that almost the 
entire sample had mastered the alphabet. 

The Test of Word Attack Skills . Table 2.5 grves the reliabilities for 
each level as well as for the total test, the Kuder-Richajdson Formula 20 
beine used to determine the reliability coefficients. 



Table 2.5 - 



RELIABILITIES FOR THE TEST OF WORD ^ ATTACK SKIUS 



— ^ 1 

Test/Level 


Reliability 


Total Test 




.91 


Level A 




.61 


Level 




.86 


Level C 




.79 

• 9 



The lowest reliability coefficient was for Level A. all others ^"d "ting 
that ^he test as a whole and each of the other parts provided a «aso<ab e 
lea ure^f :hat was intended to be tested. Due to ^^^^^^^^ ° .r.^^as e 
the data for Level A. this part being very easy for the ^^^P^^ ^^^^^ "^^^^ 
case for -the Alphabet Test- and the fa.t that there were only 13 items, the 
reUaMlitv c oefficient ca lculated was low. For this part of the test, seven . 
itelsieie passed by more than 95% of ttie sample. Only six items were suffi- 
c^Pntlv difficult in order to determine whether they contributed toward 
d c imin ig b ti^en high and. low achievers. By examining ^he item analysi 
(Table 2?6) for Level A along with the specifications for the i«ms Table 2.3) 
these six items can be identified as the three items to measure auditory 

i i^ nat'rand three'of the four items for --"'^^"^ ""f, J ^^/^ 
sight vocabulary, item 9 being the one item that was exceptionally easy. 



Table 2.6 



ITEM ANALYSIS FOR THE TE ST OF WORD ATTACK SKILLS 



Level 


Item No. 


Percent. Passing 


r--biserial 
for Part 


r-biserial 
fnr Total Test 


A 
A 


1 


91 


.66 


.62 




2 


91 


.84 


.60 . ' 




3 


84 


.85 


.49 




4 


99 


\* 

"S 






5 


100 




* 




6 


' 99 


* 


* 




7 


92 


.76 


.67 




o 


95 


.81 


.68 ' j 




Q 

y 


97 


* 


-1 * ! 

1 — — n 




1 n 


95 


.84 


.75 




1 1 

i. i. 


" 100 


* 








97 


* 


* 






99 • \ 


* 


-— \ 


TJ 


1, H 


1 ^ 

99 ' \ 


* 




D 




■ 

97 ^ 


* 








97 


\ * 


* 






97 




* 

-4 r 


* 




1 ft 


93 


\ .62 


.57 




1 Q 


88 


.30 


.37 




20 


97' 


* 


* 


r 




99 


* 






77 


9^ ' 


* 








23 


91 


.72 


.78 ' . 






24 


71 


.65 • 


.51 






25 


91 


.84 


.78 






26 


69 


.55 


.43 






27 


31 


.64 


.56 






28 


63 


.61 


.56 






29 


• 76 


.75 


.74 




1 


30 


85 


.60 


.60 J 



# 



33- 



1 



Level 

• 


Item No. 


Percent Passing 


r-biserlal 
•for Part 


1 

r-biserial 
tor Total iesL 


B 


31 - 


36 


.72 


.73 




32 


75 


.76 


.73 




33 


17 


.26 


.09 




34 


33 


.69 


.66 




35 


60 


, .68 


..61 




36 


95 


.78 


.68 




37 


96 


* 


* 




38 


76. 


.31 


.24 




39 


97 


^ * 


* 




40 


85 


.56 


.61 




, 41 


64 


.70 


.60 j 




42 


53 


.64 


,58 / 




43 


80 


.64 


.63 / 




44 


71 


.82 


.83 / 




45 


67 


.59 ■ 


.59 / 

/ * * 


C 


• 46 


48 


.33 


.26 / 




47 


60 


.48 


.49 / 




48 


81 


.68 


.70 / 




49 


63 


38 


.44 . / 




50 


80 


.80 


.87 ' / 




51 


21 


.40 


.42 / 




52 


29 . 


.58 


.55 / 
> 1 




53 


53 


.52 


.37/ 1 




54 


• 32 


.42 


. 35' ■ 

. - v 




55 


60 


.70 


.5S 




56 


95 


.94 


--h- 




57 


96 


* 


/* 

J ■ 

) 




58 


89 


.65 


/. 64 

- — 1 — 


• 


59' 


72 • 


.48 


/ .50 




1 60. 


■ 81 


.6,7 


i .59 




r 61 


36 


. - .59 


z 

.-48 




— w — 

62 


69 


.74 


: .67 




63 


65 


.75 


. . 59 




64 


57 


.54 


; .46 




65 


55 


.63 


.52 


f 


66 


77 


.45 


/ .46 



ERIC 



*The r-biserial was greater than 1 due to lack of normality in the dichotomized 
variable and the inexact nature of the estimation procedure. ^. 
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With respect to Level B' th'e item analysis (Table 2.6) shows that 
for this sample, the items intended to measure recognition of .initial 
and final consonants were exceptionally easy for the sample and, there- 
fore, did not contribute toward the discriminating power of this part 
of the test nor the total test.- One exception to this was item 19 in 
which the subjects were asked to identify the grapheme r for the final 
phoneme in the word "water." It is to be noted, however, that the 
r-biserials for this item were .30 and .37, for Level B and the total 
test respectively, which shows that the discriminatory power was low 
and particularly so wl«ti 'coojpared to that of other items in the test. 
One other set of items in Level B, those for measuring the use of 
context clues, appeared to be very easy for this sample, one item 
being the exception. However, this item (38) did not appear to be . 
discriminating very well between high and low achievers on the total 
test, although it may have been functioning at what might be considered 
a satisfactory level for the part of the test to which it belongs. 
Although another item (36) in this set of four items on the use of 
context clues was passed by 95% of the sample, it still seemed to have 
discriminating power for both Level B and the total test. 



Level C had a lower reliability coefficient than Level 
was most likely a function of the fact that Level C has 11 i 
than Level B. In Level C, only one item (57) in the set uf 
for measuring the use of context clues was exceptionally eas 
sample. Also, one item (^6) in the set of five items intend 
structural analysis did not seem to have a high level of dis 
power for Level C nor did it reach a satisfactory level of d 
power for the total test'. • - * 

/ 

The means and standard^eviations for the parts and tot 
Word Attack Skills are given in Table 2.7. This table also 
range of obtained scores in the sample as well as the total 



B but this 
terns less 
four items 
y for the 
ed to measure 
criminating 
iscr iminating 



al Test of 
shows the 
possible score, 



Table 2.7 

MEASURES 0? CENTRAJ- TENDENCY AIID DISPERSION OF SCORES 
OK THE TEST OF WORD ATTACK SKILLS 



1 

Test/Level 


1 

» Total 
Possible 
Score 


1 
! 

Range of 
Obtained 
Scores 


Mean 


i 

Standard Deviation 


Total Jest 


66 


15 - 66 


50.0 


t 

i 


• Level A 


13 


! 7-13 


12.4 


1 1.1 


Level B 


32 


5-32 


24.5 


' 5.0 

i 


Level C 


21 


i 1: - 21 


13.2 

1 


1 4.0 
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This information reinforces the discussion above regarding the 
difficulty of the test. Level A was obviously extremely easy. The 
test as a whole as well as Level B and C appeared to be relatively easy 
for this sample also, but there seemed to be a sufficient range in scores 
to indicate that the test was measuring a wide range of ability within 
the sample. 

The Test of Oral Reading . This test was intended to consist of 
four passages of increasing difficulty. The first three passages were 
to q^rrespond to the three parts of the Test of Word Attack Skills , 
Levels A through C, which also were to be of increasing difficulty. 
That is. Level A in the Tfest of Word Attack Skills was to correspond to 
the first passage in the Test of Orarl Reading , Level B to the second 
passage, and Level C to the third passage; each of the three levels in 
the Test of Word Attack Skills were to be based upon the decoding skills 
def|.ned in the hierarchy outlined by the committee and each level was 
to have a corresponding passage in the Test of Oral Reading . The fourth 
passage in this test was to be taken from the 170 reading tasks in the 
National Reading Performance Survey, the passage being at the fifth" 
or sixth-grade reading level. Figure'2'1 shows the mean level of 
difficulty on a common scale for each of the three parts in the Test of 
Word Attack Skills as well as the level of difficulty for each of the 
first three passages in the Test of Oral Reading . Also shown Is the 
range of item difficulties for the Test of Word Attack Skills . 

It is to be noted that for this sample the third passage (Uvel C) 
was easier than the second passage (Level B) , although the percentage 
passing each of these was very close. The passage for Level C was 
passed by 602 of the sample while 59% passed the Level B passage. Eighty 
percent of the sample passed the Level A passage, yet this passage was 
more difficult than any of the items on Level A of the Test of Word 
Attack Skills . The level of difficulty of each of the passages was not 
the same as the mean level of difficulty of the p^t on the Test of Word 
Attack Skills to which it was to correspond, but tfhe level of difficulty 
for each of the passages B and C was within the rAnge of item difficulty 
for its corresponding part on the Test of Wo rd Attack Skills,. 

The fourth passage in the Test of Oral Reading , the one from the 
National Reading Survey, had the highest level qf difficulty. Further, 
the level of difficulty for this passage was higher than the mean level 
of diff lenity of any other measure in the study; Only 32% of the sample 
passed this passage. . 



■ 




Note: 



The scale used is an index of difficulty (Delta) "that ranges from 
6.0 to 20.0: 6.0 being very easy to 20.0 being very difficult 
(Thorndike, 1971, pp. 139-140). 



•37- 



Intercorrelations for All Measures In the Study 



Table 2 .8 presents the intercorrelations for the measures. Generally 
speaking, all but one of the measures appear to correlate with each other 
at a significant level. The notable exception is the Alphabet Test, a 
very easy test, which appears to correlate at a significant level only 
with the Survey of Reading Material , the total and the easy part. (Level a;^ 
of the Test of Word Attack Skills . In addition. Level A of the Jest p£ 
Vtord A ttack Skills does not ap?ilr to show a significant level of corre- 
lation with the passage from the National Reading Survey, the most difficult 
passage in the Test of Ocal Reading . It is important to note that corre- 
lation coefficients tend to be suppressed by lack of score variance, and 
for some measures in this study there was little score variance. 

Discussion of the Results 

The Decoding Instrument . In order to determine whether or not the 
inability to answer correctly the adult functional reading tasks in the 
Survey of Reading Materials is attributable to inadequate decoding skills, 
it is necessary to determine if the decoding instrument developed for 
this study was a valid and adequate measure of decoding skills. Before 
focusing on the decoding instrument, it is necessary to put things in 
perspective. The data available is abased on a rather small sample, 77 
adults. Further, the sample was not a random sample of the adult popu- . 
lation consisting of those both with or without major decoding prcblenu.. 
although the sample selection was based on obtaining a wide range ot 
reading ability. To this extent, conclusions drawn from the data could 
be rather tenuous and in need of further consideration through either 
replication of this study with other sample(s) or new studies which take 
the information here and build upon it, possibly through further develop- 
ment of the measures. With this in mind, it is possible to turn to a 
discussion of the decoding instrument. 

First, the question of validity is examined. One reason for 
including the passages in the Test of Oral Reading was to build into 
the study a way of measuring concurrent validity for the paper-and-pencil 
test of decoding skills. Although every effort had been made to restrict 
the decoding skills required to read each of the first three passages . 
In the Test of Oral Reading to only those decoding skills being ffl^sured 
by thP r^rresponding part of the Test of Word Attack Skills, the data 
may give the impiession that this was not done. since the m.ean .eyel ot 
. difficulty for each of the parts of the Test o£.Word Attack Skills does - 
not correspond to the level of ' difficulty of the passage to which it was 
to correspond in the Test of Oral Reading . However, each test contained 
only a sample of the skills to be tested and it was not possible to„ 
sample pxactly the same components of a skill in both the Test of Oral 
■ Reading and the Test of Word At tack Skills. Further, the data ^^ows 
that the. passages do not fall into a hierarchical order in terms of level 
of difficulty', but this may be a function of the scoring criteria. The 
Level B and C passages are not in the order intended in terms of level 
of difficulty; they are reversed. The criterion for passing the Level A 
or B. p.issage was to allow no more than one error whereas for the Level C 
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passage no more than two errors were allowed. lo other words, perhaps • 
passing the Level £ passage was made easier by allowing one error more 
to b^ made than wal alWd for the Level A or B passage. This, is certainly 
something to' be considered in the subsequent use and/or development of 
this instrument. Perhaps for the reasons giv^ abov6 the mean, levels ot 
difficultly for the three parts of the Test of Word. Attack Skil ls were not 
congi^ent with the levels of difficulty for the first thre,e passages i» 
the Test of Oral Reading , yet this does not mean that the paper-and- 
pencil test of decoding skills was not valid. Table 28 shows that the - 
corresponding levels of the two tests are significantly correlated at the 
.01 level. - ' ' 

. r What beco^ies apparent from^he data for the Test of Wo rd Attack 
Skills and the test of Oral Reading is that, given the two testa, with 
the scoring criteria/procedures used in this study, the oral reading 
of the t)assages does not provide the range of information about a subject 
or a sample that the Test of Word -Attack Skills, does.^ This might not be 
the case, however^ if the scoring were differSnt for the oral reading.' 
Apparently, this is^an area which requires additional investigation; 

Perhaps because' decoding is a complex process it has? been difficult 
^to define. Even when great care has been taken in defining it, as was 
^ the case for this study, there are still questions to ask^^ One such, 
question is:. Does oral reading of a passage serve in determining, con- 
current validity for another, measure that calls upoa decoding skills 
f or' gi^aphemes and morphemes tiot^ in connected discourse?^ Perhaps 
"fluency of decoding" is one factor that may affect results 'on one 
meMure but not the other. And this may , not be all. It might be that 
decoding individual graphemes ar^d morphemes may call upon skills that 
are in some way different fyom those fDr decoding sentences and/or 
passages even when they ar& to be read word by word. Jliis, of course, 
is no£.a n^w thought. It was recently well discussed at a conference ^ 
on th'e relationships between speech ajid learning to read sponsored by 
the National Institute of Health (Kavanagh and Mattingly 1972) . 

^ Before leaving the discussion of the "decoding instrum^t, it^is 
necessary to comment Qn the remaining measure, the Alphabet Test . 
This test was included because of. the many findings that have shown 
knowledge of the alphabet to be a predictor of reading achievement in 
children (Chall, 1967, pp. 155-159). The data from the present study 
showei that almost the entire sample had mastered the alphabet, yet 
some, of those who had did not do well on the '^tjher decoding ipeasures. 
Further, it v>as noted Jihat the Alphabet Test appeared .to be significantly 
correlated only Vith the Survey of Reading Material (at the .01 level), 
the total Test of Word Attack Skills (at the .05 level) and Level A, 
the easy part of the latter test (at the .01 level); however, for the 
Alphabet Test there was little score variance. For another sample with 
greater variability in scores on this test^ the correlation coefficients 
may be' larger than they are for this sample. Speculation is possible. 
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. Could it be that knowledge of the alphabet may not be as good a pre- 
dictor for some aspects of reading achievement in adults as it is for 
other aspects? Perhaps it best predicts achievement for the reading, 
skill (s) that are most like the skill (s) required for learning the 
alphabet, for example recognizing a symbol for its orally given referent, 

'clearly, additional research is needed in this, area; in fact, a study 
including regression analysis might. well provide greater insight as to 
the strength b'f a f.actor like knowledge ,of the alphabet as a predictor 
of t^he various aspects of reading achievement, granted a difficult task 
since the components of reading have yet to be generally agreed upon 
(Farr, 1969). \ 

Ability to Dec ode as Related tO-Succe ss on the Survey of Reading 
Material. As was expected, the data from this study clearly indicates 
that the ability to decode is a predictor of success on the Survey ot 
Re:Si n. Material a sample of the adult reading tasks in the Nat onal 
Survey of Reading. All of the decoding measures were significantly 
correlated with the Survey of Readi ng Material at the .01 level. 

TO illustrate this point further. Table 2.9 lists the mean scores 
on the Alphabet Test and^the Test of Word Attack Skills -for f^^e groups 
' of adults with increasing scores on the adult reading tasks. Each 
group contains approximately 20% of the sample. 

this table that those who da well on the Survey or Reading Material 
also tend to do well on the other fests. 



Table 2i9 



DISTRIBUTION OF MEAN SCORES BY QUINTILES 
FOR THE SURVE"WJL READING MATERIALS 



Survey of Reading HatefmX 



Score Interval 
30-33 
25-29 
19-24 
14-18 
1-13 



Mean 
30.9 
27.6 
21.2 
16.4 
7.3 



Al phabet Test 
25.9 
25.9 
25.6 
' , 25.8 
25.3 



Test" of Wotd Attack Skills 



Level A 
12. '8 
12.6 
12.7 
12.5 
11.7 



Level B 
26.9 
26.8 
24.3 
24.2 
■21.9 



Ltevel C 
16.5 
15.9 
13.6 
12.3 
10.3 



Total 
56.2 
55,4 
50,6 
48.9 
43.9 



ERIC 



An attempt was made to determine a critical score on the various 
decoding measures which would predict success on the Survey of Beading 
Material (Guttman, 1941; Guilford and>lichael, 1949); however, this was 
not possible given the data from this sample. Again, the characteristics 
of this particular sample and/or the scoring' procedures for the various 
measures may have been factors in preventing the identification of the 
critical score. Also, the instruments appear to need further development 
work and refinement. Further instrument development, and research is 
indeed indicated to determine if there is a critical decoding score (level 
of ability) to predict success on the adult reading tasks. 



Stimmary 



This study has been only a first ste^^ in the direction of solving 
the question to which it was addressed. In the discussion above, 
additional efforts are indicated. Clearly, the decoding instrument 
used needs further development work before it can be considered to be 
in a final form for use. as a measure to diagnose decoding ability in 
adults. Also, further research is needed to .identify a critical score 
or critical level of decoding ability for adult functional literacy. 
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SPE CIFICATIONS FOR A RESEARCH INSTBUMENT 
FOR EVALU ATING WO RD ATTACK SKILLS IN ADULIS 

I. Naming the letters of thSsalphabet 

II. Reading three passages which are constructed to evaluate specific 
f skills that are believed to develop hierarchically. 

The focus of each of the three paragraphs will be as follows: 

*Level A - Auditory discrimination 
Visual discriminatioih 
Recognition of basic sight -vocabulary 
Use of context clues 

**Level B - Recognition of initial consonant sounds and their 
graphemic options" 
Recognition of final (ending) consonant sounds and 

their graphemic options 
Recognition of short vowel sounds and their graphemic 
* options 

Recognition of long vowel soxjnds and their graphemic options 
Recognition of diphthongs and their graphemic options 
Recognition of digraphs such as. some vowel digraphs 
(ay, ea, ee) and consonant digraphs (sh, th, ch) and 
* their phonemic options ' • 

Use of context clues 

Use of structural analysis such as some derived forms 
(re-, dis-^mls-, un-, -est,* -er, -tion, -[a]ble), 
pluralization, Contractions 

***Lev€l C - Use of structural analysis- including derived forms, 

pluralizations, contractions, verb' tense, inflectional 
endings. 

Recognition of "digraphs, including vowel digraphs, conson- 
ant digraphs, VC digraphs, r controller and their 
phonemic options 

tJse of context clues 

Syllabication 

Blending syllables 



Note: * = Approximately upper first grade 

** = Approximately upper second or early third grade 
*** s Approximately middle or upper fourth grade 

(A fourth paragraph from the National Reading Survey will be given 
following the three above (Level A-C) and this fourth paragraph 
.will approximate 3 f ifl^ or sixth-grade level) 



1 



Level A is the base level with Level B at a higher level and 
Level tS the highest level to be tested. 

Working through three sets of test items— one set for each passage- 
each of which focuses on the skills in the passage to which it 
pertains. 



( 
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TEST ATOCLNISTRATION PROCEDUKES 



The examinee will be asked, first, to identify letters of the 
alphabet as they are said. Second, the examinee will be asked to read 
the Le^el A paragraph, then, the Level B paragraph and, finally, 
the Level C paragraph, in that- order. If the examinee cannot read the 
Level A paragraph, he will not need to go further but will be a^ked if 
he can read any words in the other two paragraphs. If he reads the 
Level A paragraph, he will be asked to read the Level B paragraph^ If 
he cannot read the Level B paragraph, he will not need to go further 
but will be asked if he can read any words in the Level C paragraph. 
If he can read the Level B paragraph, he will be asked to read the 
Level C paragraph. 

The scoring of the paragraph readings will be as follows: 

- Only 5 errors per 100 words will be permitted; this ratio of 
errors will be maintained for paragraphs of more or less than 
100 words. 



- Errors include: 

omission (except articles or words that appear more than once) 
substitution 

additions (such as insertions) 
position change 
needed aid in pronunciation 
mispronunciation (except when examinee follows rules of 

pronunciation but word does not) 

- That which are not errors include: 

repetiton 

pausiiig (hesitations of short periods of time) 
not following punctuation 

In addition to the paragraph reading, the examinee will be given 
three sets of test items covering the skills on which the paragraphs 
focus. 



•# 
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CHAPTER 3 



relat;ionship of functional reading to performance on cloze tests 

In Chapter 2, the relationships between functional reading and 
decoding skills were studied in order to determine whether inability 
to read functional materials is due to lack of decoding skills. In 
this chapter,- relationships between functional reading and performance 
on cloze tests are examined. The cloze test, as explained below is a 
method for assessing reading skill. Measures obtained by cloze tests 
have'been relat^^o measures obtained by more traditional tests in an 
attempt to vTlidatfe the^thod. In this phase of the study, scores on 
functional reading test^and scores on cloze tests are related in an 
attempt to demonstrate concurrent validity between these two methods 
of measuring reading skill. 

Selected Rgading Tasks 

The reading tasks were a subset of the 170 functional reading 
tasks developed by Educational Testing Service as part of the Adult 
Functional Reading Study. Each rfeading task consists of two com- 
ponents: 1) a stimulus that is a sample of realistic reading material 
the comprehension of which is judged to be of high benefit to the 
reader; and 2) a required performance that serves to indicate whether 
or not the stimulus was comprehended. The reading tasks have been 
administered to a national probability sample of 8,000 adalts and, data 
on the difficulty of each task are available (Murphy, 1973). 

Selected Cloze Tests 



The -cloze tests were based on a subset of 36 passages that had 
been scaled tor difficulty using an extensive set of tests (Coleman 
and Miller, 1968). Available for each passage are data related to 
difficulty based on: 1) percentage of correct responses on cloze tests 
in which every fifth word was deleted; 2) percentage of correct responses 
on cloze tests in which one word per passage was deleted; 3) percentage 
of correct responses when subjects guessed every word after seeing the 
preceding word in the passage; 4) percentage of correct responses when 
subjects guessed every word after seeing the preceding word, after having 
read the passage once; 5) the difference between ^3 and #4 which is 
interpreted as information gain; 6) mean number of content words an 
adult recalls after studying the passage for 60 seconds; 7) mean sub- 
jective rank order of difficulty as ranked by 14 judges (Aquino, 1969). 
It should be pointed out that these data, while extensive, are based on 
college student subjects, and the degree to which they are generalizable 
to other populations remains to be established. 



Advantages of Cloze Tests 



Cloze tests are of interest for both practical and theoretical 
reasons. The primary practical advantage is that cloze tests are ex- 
ceedingly simple to constiruct. Every nth word is deleted from an 
appropriate passage and the subject is asked to "fill in the blanks. 
That exceedingLy simple test construction process leads to scores that 
^re "highly valid measures of the readability ^of printed materials and 
the compreheij^ion of readers" (Rankin and Culbane, 1969). 

From a theoretical point of view, cloze tests have a significant 
advantage over traditional tests of reading comprehension in that the 
construction of cloze tests can be based on an algorithmic, replicable 
procedure free of bias. Consider the fact that traditional reading tests 
generate scores based on the questions that haye been written to measure 
comprehension of a particular passage. It is well known that questions 
of various- levels of difficulty may be written for the same passage. For 
multiple-choice questions, the same stem will provide items of various 
levels of difficulty depending on the distracters that are selected to 
accompany that stem. For a given population, the percentage of correct 
responses to a set of questions on a reading passage depends not only on 
the inherent difficulty of th« passage itself, but also on the particular 
set of question stems that happen to have been written and on the particular 
set of distracters chosen for each question stem. The choice of question 
stems and distracters is, to a great extent, a function of the personal 
biases of the item writer. 

Using 'traditional tesTS of reading comprehension,, it is not 
possible J:o make rigorous Judgments of the difficulty of written text. 
Measures of the difficulty of a set of questions based on a given text 
are obtained and inferences are made about the difficulty of the text. \ 
It must be kept ^in 'mind, however, that a different 9et of questions 
based on tl5jl same text would lead to different judgments of the diffi- 
culty of that tfext. On the other hand, it must be noted that traditional 
reading test^allow the measurement of relatively distinct skills such 
as understanding of the main idea, making inferences,' etc., which are 
not measured by cloze tests. While the question of the exact nature of 
the skill tapped by the cloze procedure remains the subject of debate, 
. and the way in which this skill is related to the reading process 
requires further elucidation, it is clear that success in this task 
requires ^^sensitivity to the redundancy and syntactic structure of 
English. Thus cloze tests go beyond the vocabulary and general know- 
ledge demands of traditional comprehension items, and are compatible 
with linguistic theories of reading. 

The use of cloze tests obviates the biasing effect of the item writer. 
It becomes possible to strictly delimit the universe of all possible cloze 
items for any given string of text and to generate strictly random samples 
from that universe allowing unbiased estimates of performance on the 
universe of items from performance on the sample of items (Bormuth, 1974). 



Score Interpretatio n Cloze Tests 

Because the u=e of clo,. tests '.tuy'^otSriar^sfrr 
the use of tradttlonal .ensures /"^J"* f/, ^/.i/i"^™ various 
have bee„ unablo « generate •^'J "3^ "J^^^f^^J.eft an acceptable 
IIZ' 1r"u1s'rercr;t"crecrr^5ulfe/to"indlcate. comprehension of 
reading material has been attained? 

The wide experience with traditional measures has shown certain 
"rules of thumb" to be useful: 75 percent J^!^^ [1^^ 

ditional questions has been generally accepted as indicating a level 
of difficulty that is suitable for instructional "se. and ^0 percent 
correct has been accepted as indicating a level ^^^^^^ ^'^f 

suitable for independent study (Harris. 19^Z). ' ^^^^^f 

fact that a given absolute percent is a function of the items to at 
least as great an extent as of the difficulty of the passage. 

Efforts have been made to show the relationship between cloze ' 
test scores and multiple-choice test scores (^Bormuth^ 1967. Rankin 
and Culhane, 1969). In general, a cloze scor^e of 40* 4 Percent can 
be taken to be equivalent to a raw score of 75 percent on a typical 
multiple-choice test based on the same reading materials. 

Comparable Reading Task and CIozp Tt^'^f Difficulties 

One way of relating the reading tasks and the cloze passages was 
to con^pare the difficulty levels of the selected reading ^asks with 
the difficulty levels of the selected cloze tests. Each reading task 

roduced a binary score: right or wro;.g. Each cloze h--"; 
coMld produce a range of scores from 0 to 30. scoring one P°i"J 
each deletion correctly replaced. The difficulty ^f.^^^^'^^^f"^ task 
could easily be stated as the percent of the population that se ected 
.the correct response. In order to obtain comparable ^l^^lll ^tf - 
cloze passage, a cutting point had to be selected on f.^^ «-°^^^^^J^^^ 
or below which the passage would be scored as wrong, and above which 
the passage would be scored as "right^ 

Bormuth (1971) has given evidence that readers who score J^^s than 
approximately 35 percent on cloze tests can gain little or no information 
fill materials 'at that level of difficulty. Since 

yere designed primarily to discriminate between literate and i^i^erate 
70 ulations.'tL score level congruent with the abil ty ^° J^^" ° 

Ltion from a passage was selected as the cutting point. 

study, the difficulty of a cloze passage can. therefore, be stated in 
'term^ of the percent of the population that score 11 or de etions 

correctly replaced. That percentage can be compared ^i^^^^J ^7^^^, '^^^ 

percentage of the population responding correctly to a reading task. 

Clearly, the mapping of reading task difficulty into cloze test 
difficiuj i not unique' It will vary if the cutting score on the cloze 
test varies. For that reason, dat. are reported that will .allow the 
^ pinj to be done for all possible cutting «ores. Such a comparison 
is meaningful only to the extent that the two sets of tasks covary. 
T^afis. to the degree that those who pass the reading tasks ij^clude the 
Teople ^ho experience success on the cloze tasks. The extent to which 
this is the case will' be discussed in a later section. 



Test Description 

Six tests were constructed, each containing 18 reading tasks 
and three cloze passages/ The three cloze passages and three reading 
tasks, coranon across grades, were placed in the same position in each 
test booklet. The 15 remaining reading tasks werd ranked according 
to difficulty level on the national survey. However, rather thaa 
simply ordering the tasks in the test booklets according to difficulty 
level, four of the easier tasks were placed at the end of each test 
booklex. This was done to insure that students would have the oppor- 
tunity to attempt thfe more difficult reading tasks. Our intention 
was to allow sufficient time so that non-resp9nses could be interpreted 
as inability to respond correctly. If some students did run out of 
time, then the last few items could be deleted from the analysis with- 
out losing the range of item difficulties present in the study. 

A complete description of the six teste,, two for each of grades 
7 10, and 12 is given in Table 3.1. Cloze passages are identified by 
tlie letters A through H. The reading tasks are identified by the 
listings used in the national survey. Reading tasks administered 
'across grades are noted by asterisks. 

Table 3.1 . 



TEST DESCRIPTION 



Page 

1 
2 
3 
4 
5 

* 6 
7 . 
8 
9 

10 . 
*11 

13 
14 
*15 
16 
17 
18 
19' 
20 
21 



Grade 7 



4-2 
2-2 
A 

2- 3 
C 

1-1 
7-2 

3- 1 
E 

6- 3 
10-11 

7- 5 

8- 6 

4- 6 
6-9 

10-10 

1- 14 

2- 6 

9- 1 
10-8 

2-11 



II 

4-3 

1- 2 * 
B 

4- 1 
D 

8t1 
lr3 

2- 1 
F 

2- 10 

7- 3 

8- 4 

9- 7 

3- 4 
6-13 
9-5 
1-6 
9-2 

•5-2 

5- 3 
9-14 



Grade 


- 10 


Grade 


12 


r 


II 


\ 


U 


5-6 


7-14 


6-1 


9-11 


6-8 


10-4 


1-17 ■ 


5-10" 


B 


C 


C 


D 


3-10 


10-9 


4-10 


1-16' 


D 


E 


E 




1-1 


8-1 


1-1 


8-1 


6-2 


5-1 


6-14 


8-8 


5-16 


&-6 


2*14 


2-17 


F 


G . 


G 


H 


2-8 


6-12 


1-10 


5-11 


10-11 


7-3 - 


10-11 


7-3 


10-7 


3-12 


8-13 


10-15 


7-6 


-9-6 


4-15 


4-13 


1-11 


7-4 


3-13 


8-9 


6-9 


6-13' 


' 6r-.9 - 


6^3 


8-5 


7-12 


3-15 


10-17 


9-9. 


3-5 


5-15* 


9-13 


3-8 


8-7 


8-15 


6-16 


1-7 


10-2- 


• 8-12-^' 


4-16 


7-9 


6-4 


6-11 


9-10 


5-13 


4-9 


2-16 


9-16 



Test Administration 

The tests were administered by four ETS staff members in student 
classrooms. Each class was tested on two consecutive days. Students 
who were absent on one of the days completed only one test. Average 
administration time was approximately 45 nfinutes. Some teachers re- . 
mained in the classroom, assisted in distributing the materials, ^nd 
showed considerable interest in the test administration and materials. 

After the tests were distributed, brief instructions were given 
to the students ^ marking procedures for both the^eading tasks and ^ 
the cloze passages. Student\s indicated their responses directJLy -in_^ 
the test booklets. Although the test was not strictly timed, -the students 
were^sked to move on to pages 4, 6, and 10 after intervals of approximately 
ten min>ites if they had not already done so. The students were encouraged 
to go back over the test if they finished early. 



Scoring 



Each' student was assigned a unique identification number which 
was used to match the two test booklets for the two consecutive days. 
Then the reading tasks were scored as right j wrong, or omit .using the 
coding specifications for the national survey. _ The cloze passages 
were scored allowing exact replacement only. Every item was scored _ 
as right, wrong, or omit. Interpretable misspellings were scored as 
Correct. The item scores were then transfered to machine scorable 
answer sheets for the analysis . 

S,esults 

Based on the observations of the ETS test administrators, most 
students found the materials to be interesting and motivating, although 
some 12th grade basic classes showed a disposition to treat the task 
with no more seriousness than, from their perspective, it dese,r<red. 
Some students asked questions about the materials at Che end of ^ 
testing session; a few were observed discussing, the materials and\ 
arguingtabout their responses. The total, sample of students tested 
was ;;87$ 244 in grade 7 , 257 in grade 10; and 286 in grade 12. In al] 
32 classes in 7 scSools participated in* this study. 

The means an* standard deviations for the six functional reading 
tests and the ei#t cloze tests are given in Table 3.2. The reading- 
tasks administered to the 12th grade students were more difficult ttjan 
those administered to the 10th grade students. The least difficult 
tasks were administered to the 7th grade students. The complete item 
statistics for the reading t^sks are given in Table 3.3. As explained.- 
earlier, it was projected "that students would have sufficient time to 
complete all the tasks and that .non-responses would be 'interpreted as 
inability to respond correctly. Moderately large percentages of students 
omitted the last few items. For this reason, the percentage of non- 
" responses is also given for each item. For comparison purposes, the. 
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Table 3,2, 



DESCRIPTIVE STATISTICS 

^ ' ^ . Grade 7 Grade 10 Grade 12 

Mean (SD) Mean (SI>) Meah (SD) 

Reading Tasks 

T^st I • ^ 1^.8 (4.2) 13.9 (4.8) 10. 0 (5.^^ 

Test il ' 14.7 (4^.3) 13.9 (5.2) ^ 10.9 (5.8) 

Cloze Tests 

^ A 13.7 (6.3) 

B 17.9 (5.8) 17.0 (6.0) 

* C - 16.3 (6,5) , 17.5 (6.^ 16.3 (7.5)' 

^ D 



E 
F 
G 
H 



12.5 (5.7) 13.7 (5.8) 12.6 (7.3) 

5.3 (4.0) , 6.8 C4.6) 6.8 (5.1) 

; 7.9 (416) 9.2 (5.2) 9.2 (6.0) 

. 8.7 (5.4) 8.7 (5.7) 

^ 12.4 (13.2) 



•Hi^iculty levels from the ijational survey are also included in 
'^l^k 3.3. Common items have been marked with asterisks to allow 
^H^rison across grades. In general, the 10th grade students per-_ 

formed better than the 7th grade students, and the 12th grade students 

performed about -^E^ell as. the 10th grade students. 

The percentages of students who "pa&sed" the cloze passages, 
i.e. filled in 11 or more blanks correctly, are given in Table 3.4. 
On the more difficult cloze passages, the students performed as 
would be expected. On passage B (grade level 1.5), the lOth grade 
students scored slighxly lower than the 7th grade students. On 
paHage C (gr^e level 5.7), the 12th grade students performed less 
well than the IQth^grade students. This is not an uncomidon finding 
\jhe^ a single pafessfge is used for a cloze test across grades. When 
^he vocabulary included in the passage is more akin to that of the 
younger students, older students tend to use more complex synonyms • 
Since scores are based on exact word replacement, older students tend 
to score less well. The result is not important in this study as the 
.relationships between 'the cloze tests and the reading tasks are inter- 
preted only within grades^. That is to say, a cloze test and a reading 
task may have similar difficulty levels- for grade 12. That relation- 
ship may or may not hold true for the other grafdes. For exanple, 
passage C is about as diffTiult for the 12th grade students as is the 
common reading' task 10-il. That is not the ca«e for the 7th grade 
students, liable 3.4 alsc presents coefficient alpha reliabilities 
for each passage. As expected, maximum reliability occurs for each 
grade if a passage is of intermediate difficulty for that grade. 
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Table 3. A 

CLOZE TESTS 
ITEM STATISTICS 



Cloze 
Passage 

A 
B 

C 
D 
E 
F 
G 
H 



Grade 
Level 

7.1 
1.5 
5.7 
6.0 
6.8 
5.9 
9.6 
7.9 



Grade 7 




Grade 10 




Grade 12 




% Pass 


alpha 


% Pass 


alpha 


% Pass 


alpha 


77 


(.87) 










93 


(.81) 


92 


(.70) 






88 


(.87) 


96 


(.79) 


88 


(.77) 


78 


(.86) 


84 


(.83) 


85 


(.84) 


9 


(.81) 


26 


(.83) 


31 


(..84) 


29 


- (.83) 


51 


(.89) 


63 


(.83) 






49 


(.85) 


53 


(.85) 






• 




22 


(.83) 



V 

As mentioned at the beginning of the chapter, the criterion 
score used on. the cloze tests was 11. Students who filled in fewer 
than 11 blanks correctly failed the cloze test. Other cutting scores 
are possible. Complete distributions of the students on the cloze 
tests are available for every combination of reading task and cloze • 
passage. These data are for those students who responded to both. 
It allows cloze passages and reading tasks to be compared across days. 
(Jf*course, the numbers of students included for the various combina- 
tions are different. For this reason, the difficulty levels for the 
cloze passages and the reading tasks differ from the overall values 
given in Tables 3.2 and 3.3. However, this information is noteworthy. 
Many students who fail the cloze passage manage to pass many of the 
reading tasks. This is another way of looking at the difficulty ^ 
levels. In view of the fact that the stated grade levels for the 
cloze passages ranged from 1.5 to 9.6, the data suggest that many 
students who are unable to "gain information" from these passages are 
able to respond correctly to ordinary real life reading tasks. 

Relationships Between th4 Cloze Tests and the Reading Tasks 

Why should any relationship be expected between these cloze tests 
and the reading tasks? Both are tests of reading skills. Admittedly, 
they may relate to different facets of reading. The reading tasks are 
everyday kinds of tasks. The cloze passages are paragraphs from a series 
of reading texts. In' general, the scores of the students on these two 
tests are moderately correlated. Students who perform well on one test 
perform well on the other , in general. Thus the two tests tap a common 
factor of ability as well as possessing specific and error variance. 



6j 
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Table 3.5 gives inter correlations of the total reading and cloze 
scores for each day. Correl^ions above the main diagonal are based 
on all students present fpr both days of testing. Students who omitted 
entire cloze passages were given zero scores for those tests, ine 
generally lower correlations below the main diagonal are missing data 
correlations, with students not attempting certain cloze passages 
counted as missing for those passages. Entries on the main diagonal 
are' reliabilities,, coefficient alpha ^n the case of the reading tasks, 
and split-third reliabilities based on each day's median correlations 
for the cloze passages 

' Examination of this table reveals' that the reliabilities range^ 
from .78 to .90^ with the lowest reliabilities occuring among the 12t;h 
grade students. The h^ighest correlations in each grade are those or 
the two days' cloze totals. The two sets of reading tasks were next 
most strongly related, and tended to covary with the cloze scores at 
almost as high a level, with a value of about .70 for grades 7 and lU, 
and 55 for grade 12. Interestingly, no consistent evidence emerged 
of a higher relationship afiong reading tasks and cloze tests given on ^ _ 
the same day than in those given on different days. For each g"de, 
reliabilities for the total reading and cloze scores are also given in 
Table 3.5, along with th^ correlations of these totals. It is clear 
that the two tasks have a large proportion of their reliable variance 
in common. In grade 10, for example, the reliabilities of the two 
instruments would place a theoretical upper limit of .87 on their _ 
intercorrelation if they were measures of exactly the sam^ "^^'^'.J?^ 
observed- correlation, .77, tells us that nearly 60% out of a P°- ^^^^ 
78% of ^Dhe variance in the cloze tasks is , pj^edic table by reading task 
perfor/lnce. While not unidimensional . the t^sks^s^ to be tapping 
quite similar , abilities . ^ \ 

The above results indicate that it makes sense td compare the 
difficulty levels and at least propose tentatively that students who 
can complete certain passages can probably pass ccrtag ^„ 
reading tasks. In gYade 7, for example, passage A us^ing the 35% criterion 
score, is about a| difficult as items 10-11 and 7-3. ;If the items are 
ranked acrording ?o difficulty l^vel, then specific passages c.n be matched 
• a a pr riate Lvels. This has b,en done in ^able 3 . 6. ••■Becau e t^^^^^^^^^^ 
ine tasks were generally easier than the cloze passages ,.a>n some instances 
a cloze passaL ranks below all tf,e reading tasks. If students could" read 
suciTcloze passage they could probably read most of the reading tasks 
a^oJe it! Of course, it do.s not follow that students who cannot read . 
the passages cannot read the less difficult reading tasks. 
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Table 3.5 



RELIABILITIES AND INTERCORRELAT lOlC 
Grade 7 . ^ 







R 1 


R 11 


Cl I,. 


Cl II 


R I 




(.84) 


.76 


.73 r 


.70 


R II 




.76 


(.86) 


.71 


.70 


CI I 




.65 


.63 


(.90) 


.87 


CI II 




.65 


.68 


.81 


(.84) 


cr I = 


A 


+ C + E 


"^CR = .78 


"^R - .86 




Cl 11= 


B 


+ D + F 




"^C - .93 




Note: 


Above the diagonal, N = 227. 


^low the diagonal. 





N ranges from 


196 to 22-7. 










Grade 10 








R I 


R II 


Cl I 


Cl II 


R 4 


(.85) 


.71 


.71 


.72 


R II 


.71 


(.81) 


.63 


.67 


Cl I 


.75 


.66 


(.84) 


.84 


Cl II 


.71 


.64 


.79 


(.84) 


Cl I - 


B + D + F 


"^CR =. .77 


'^R - .83 




Cl 11= 


C + E + G 




"^C - .91 




Note: 


Above the diagonal, N » 223. 


Belov the diagonal. 




N ranges from 


200 to 223. 










Grade 12 








R I 


R II 


Cl i ; ' 


Cl II 


R I 


•(.83) 


.67 


.63 


.51 


R II 


.6*7 


(.79) 


.62 


• .52 


Cl I 


.61 


.58 


(.78) 


.68 


Cl II 


.47 . 


.46 


.61 


(.80) 


Cl I - 


C + E + G 


"^CR - .68 


"^R - .80 




Cl II- 


D + F + H 




"^C - .81 




Note: ' 


Above the diagonal, N « 202. 


Below the diagonal, • 




N ranges from 


162 to 202. 







f 

^CR » correlation of total reading and cloze scores 



« reliability of total reading score 
« reliability of total cloze score 

R I: First day's total reading tasks scor^ 
R 11: Second day's total reading tasks score 
Cl I: First day's total cloze passage scores 
Cl II: Second day's total cloze passage scdres 
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At each grade level, students who failed to meet the 35% 
criterion on cloze passages of moderate difficulty managed to pass 
a large number of adult functional reading tasks. For example, in 
grade 10, item 1 reproduces a soup label containing the brand name, 
. contents, direction^, a recip<^, and the ingredients which are labeled 
"prepared from." The ite,j»-asks the students to circle the information 
that tells "what the sodp is made from." On one level, this may seem 
to be a vocabulary -Item to test understanding of the word "prepared. 
Of the 231 students with complete data, 201, or 86.6% answered this 
item correctly. Cloze passage D, a set of directions for making a 
kite with a putative grade level of 6.0, was passed by 84.8% of the 
students. Of the 196 students who passed the cloze passage, 178 or 
91% also passed the reading task_. Of the 35 who failed the cloze 
passage, 24 or 68% also passe'd the^ reading task. This implies that 
the students who fail the "litefacy criterion" on this particular 
passage are still able to respond correctly to many) of the everyday 
functional reading tasks. 

Summary 

In this phase of the study, we have related the functional reading 
tasks developed in the Adult Functional Reading Study to a few cloze 
tests. In general, the functional reading tests were considerably less 
difficult than the cloze tests. Only eight cloze tests were used, which 
/ were available from previous research. The relationships found seem 
reasonable and suggest further studies with materials more, appropriate 
to given grade levels. Especially interesting would be a study of 
cloze tests developed on more functional kinds of reading passages. 
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CHAPTER 4 



BASIC READING COMPETENCY IN THE SCHOOLS 



Are the reading tasks developed in the Adult Functional Reading 
Study suitable for assessing the reading skills of school students. 
In an attempt to answer this question, ETS entered into a 
search venture with the Bureau of Elementary and "-^^^3^^"^, ° 
Testing of the New York State Department of Education. ETS agreed 
to ^ork with staff members of New York State in developing a P-l^^n- 
ary test for experimental use with a sample of ninth grade students 
throughout the state. 

Instrument Development 

Staff members of the Bureau of Reading of the New York State 
Department of Education reviewed the reading tasks J);^^^^^^^^/;,^'' 
Adult Functional Reading Study for approprifteness for use at the 
secondary level and for interest to studenW- ^""^^^^^3^"^, 
reading tasks were selected for trial administration These tasks 
were in multiole-cnoice format as used in the Group Administration 
Phlse of the ETS project 5r were adapted to multiple-choice format 
?Z\le niaonal'suivey for^ts. Consultants with experience in tne 
field of reading at the secondary level were invited ^° "^^^^^^^ 
selected tasks. Revisions and deletions were made on the basis ot 
these reviews. The tasks were then grouped into eight forms with U 
nr IS reading tasks in each form. In developing the eight forms, a 
^odeJa^e baUncrwa^built in based on the following criteria: topia. 
skill, difficulty level, benefit, and form. 

First Field Testing 

A sample of schools was randomly . selected from a population of 
New York State publir schools with the following restrictions: 

1 that the sample be representative according to- community 
■ type, i.e.. New York City, large city, small city, village- 
suburban, and rural. 

that the sample be representative, by community type, of 
the percentage of students receiving scores falling below 
the Statewide Refetence Points on the 1973 Reading PEP 
'test. 

A summary of the sample of 2,033 ninth grade students is given 
be 1 ow : 



68- 



School 


Community Typ^ 


No. of Students 


#1 


New York City 


0/. Q 


#2 


New York City 




#3 


Large City 


1 / D 


#4 


Small City 


174 


#5 


Village - Suburban 


230 


#6 


Village - Suburban 


206 


#7 


Village - Suburban 


307 


#8 


Rural 


159 


#9 


Rural 


122 



Students were allowed approximately 45 minutes to complete a form 
(14-15 items). This test was carried out in May and June, 1974. 

Results ^ 

Results show that the difficulty levels for the items ranged 

from .35 to .97. The average difficulty for the eight forms was 

.80. A distribution of item difficulties in the eight forms is 
given in Table 4.1. 



Table 4.1 

Difficulty Level No. of Items Percent of Total Items 

.90+ '48 ' 41 

.80-. 89 26 22 

.70-. 79 14 12 

.60-. 69 12 10 

.50-. 59 . 8 7 

.40-:49 5 4 ^ 

.30-. 39 3 3 



In general, the items discriminated fairly consistently between 
upper and lower scoring halves of the students. Items with poor 
discrimination indices were examined for possible revision. The 
tasks were then grouped into two sets of 40 items each witjj some 
items being deleted and some revised. The two sets of 40 tasks each 
were then used as two forms of a new experimental "test." 

Second Field Testing 

In November, 1974, the two forms of the experimental "test" 
wete administered to all ninth grade students in eleven schools; 
each student received one of the two forms. The sample of schools 
used in this second field testing was randomly selected from a popu- 
lation of New York State public schools, with the following re- 
strictions : 
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1. that the sample be representative according to coj6nunity- 
type, i.e., New York City, large city, small city, village - 
suburban, and rural. The schools were scattered throughout 
the sta'te. 

2. that the sample include an intentionally -greater percentage 
of pupils falling below the Statewide Reference Point on 
the 1973 Reading PEP test. Specifically, the target sample 
included approximately 40% of the pupils falling 'below 
that particular standard as compared to the -30% that 
actually did fall below the Statewide Reference Point. 

A summary of the sample of 2,520 students is given below 



School Community Type No. of Students 



A 
B 
C 
D 

E 
F 
G 
H 



New York City 485 

Rural 160 

Village - Suburban 375 

Village - Suburban 375 

Rural 155 

Small City 195 
Small City ~ 275 

Large City 550 



% of Pupils Below SRP on 
73 Reading PEP Test 

37 
37 
38 

♦ 41 

41 
41 
37 
38 



Students were allowed one full class period (40-45 minutes) to com- 
plete a test. The tests^ were administered by classroom teachers. 
Responses were indicated on separate answer sheets. Several members 
of the ETS project staff and the New York State Bureau of Reading 
observed the test administration in two schools and ^interviewed a 
sm^ll number of teachprs and students to get their reactions. In 
general, the reactions to these materials were favorable. Teachers 
thought the materf-ials were reasonable for assessing' functional read- 
ing. Students thought the materials were interesting and Ti^re 
motivated to respond to them. 

r • t 

Results 

Apprpximatel-y I'.OOO students responded to each form of the ex- 
perimental test. The' total possible scor^ on each form was 40. The 
mean score on fbrm A was 30.38 (S.D. .= 6.46); "the mean score on form 
B was 30.10 (S.D. = 6.48). The difficulty levels of the items in 
form A ranged from .34 to .95 with a mean item difficulty level of 
.76. On form B. diffii.alcy levels ranged from .33 to .96 with a mean 
item difficulty level of .78. A distribution of item difficulties 
in each form is given in Table 4.2. Using the Kuder-Richardson 
Formula 20, the reliability of form A was .8.5 (S.E. - 2.5). KR20 _ 
for form B was .84 (S.E. = 2.5). In general, the number of students 
omitting items increased rapidly toward the end of the test. The 
test was not intended to be a speeded test. Therefore, this informa- 
tion indicates that the test should be shortened or the time allowed 
for administration ' lengthened . 
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Table 4.2 
Form A ^or"' B 





// of 


% of 


// of 


% of 


Difficulty Level 


Items 


Total Items 


Items 


Total I 


.90f 


10 


25 


13 


33 


.80-. 89 


13 


33 


•9 


23 


.70-. 79 


7 


17 


5 ' 


13 


. .60-. 69 


0. 


6 


6 


15 


' .50-. 59 


5 


13 


3 


7 


.40-. 49 • 


2 


5 


3 


7 


-.30-. 39 


3 


7 


1 


. 3 



For comparison purposes, the scores of the students on the 1973 
Reading PEP test were also collected. The mean score for students 
who responded to-form A was, 32.62 (S.D. = 8.76) on the PEP test. _ The 
mean score for students who responded to form B was ?''.58 (S.D. - 
8.61) on the PEP test. The total possible score on the PEP test was 
50. The correlations of PEP scores with scores on the experimental 
basic reading competency test was .676 and .657 on forms A and B re- 
spectively. The percentages of students falling below the Statewide 
Reference Point on the PEP test were 37% and 30% respectively for the 
two groups. If 65% of the items on the basic reading competency test 
is used as an arbitrary cutoff score for comparison purposes, then 
approximately 20% of the students are belo^i this cutoff score. Whether 
such an arbitrary score can be assigned real meaning is a question 
that must be seriously considered by persons who use this information> 
The reading tasks in the experimental test have a certain face 
validity. But whether or not students who can respond correctly to 
25 out of 40 such items are in some- way sufficiently prepared for • 
surviving in a real life reading world is an unresolved question at 
present. Nevertheless, this kind of information has not been col- 
lected heretofore. It may be helpful to decision makers in setting 
goals, at;signing priorities, and assessing prcfgress if reasonable 
agreement can be reached that th^ test measures something valuable 
for the educational system in general and for students in particular. 
This, as yet,0tes not, been done. , . 

The correlations (.676 and .657) .reported in the preceding para- 
graph indicate that, in general, students who perform better than 
other students dn the PEP tests also perform better on the experi- 
mental test. However, an alternative way looking at th6 relation- 
ship between performance on the PEP t^sjt^afid performance on the basic 
reading Competency test might be usefulv New ^ork State commonly 
uses stanin^s for identifying groups of stuilents. In general, students 
are ordered from low to high on some t^st sc<?re. Then, the scores 
are grouped with the following percentages in each of nine groups 
from 1 to 9: 4%, 7*, 12%, 17%, 20%, 17%, 12%, 7%, and 4%. Thus a . 
stanines 1-3 contain 23% oi the students , 4-6 contain 54% of the 
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students>-and 7-9 contain 23% of tl^e students. Those studfents in 
the lowest three stanines are considered to be below some cutoff 
point. The score -corresponJiing to the'dividing point between the 
third and, fourth stanines is the cutoff score. This score is, used 
as a Statewide R^ence Point. If the division into stanines is 
periormed each y^. then a new Statewide Reference Point would be 
.determined each year, and there would always -be 23% of the students 
below the reference point. More commonly, a reference point as de- 
termined for a givenlyear and then retained for several years. Then 
progtfifes can be verified if the percentJlge of students/scorlng below 
the reference point ^decreases. In New York -State, a Statewide , 

Approximately 30% of the students were below this cutoff point in 
1973.' In th'e sample of students who responded to the basic reading 
'competency, test, approximately^ 38% were below the cutoff point. 
Fixing^ the reference point is arbitrary.. But it at least sfets a 
bench mark against 'which progress can be assessed. For comparison 
purposes; the percentages of students who fell above and below the 
arbitrary cutoff score of 25' on the basic competency test .with;in the 
' three groups of .stani'nes 1-3, 4-6, and 7-9 is given below: 



Scored 25 or, better 
bei( 



Scored beiow 25 



Stanine 


1-3 


4-6 


7-9 








21% 


44% 


15% 


"17% 


3% 


0% 



No^e that«^l this-biased sample of students 38% had scored beloW 
. the Statewide Reference Point on the PEP test. Approximately 55^ 

of those students "passed" "the basic reading competency test. For 
^'studehts above the Sta'tewide Reference Point, about 5/o of those 
Students "i«Wfed" the bas.ic reading competency test. The main point 
•of this ilI\i5tratioa is that a somewhat different set -of studfents 
may-be identified as in some way lacking in reading skills. Due to 
-the ivature of the materials in t)ie basic reading competency test, it 
nttfy the^' be more possible to e:?piain to students the kinds of reading 
•task^ that they are unable to handle well than is the case with some. 
,^staiKtardized tests. In the long-run, students mi|ht. be better mo- 
' tiv/ted to improve their reading skills if such information is avail- 
able to them. 



CHAPTER 5 



4. 

THE ECONOMIC BENEFITS OF SCHOOLINO-'AND 

READING COMPETENCE* ; 
A { 

» 

Our purpose in this task is to estimate a statistical model 
of the effects of schooling and literacy on earnings and employment 
that will illow us to calculate the economic benefits of schpollng 
and compeiitatooLeducaU£ru_jOur^irgach^^in_t t,i„ 
^ning.-irunction literature, which has been recently ana thoroughly 
reviewed b^ Psacharopoulos (1973), but our findin|s extetd the 
existing literature in three important ways. First, our -lata are 
from a 1972 probability sample of the U'.S. population over the age 
of 16; previous earnings functions h^v© been for restricted subgroups 
of the population, usually white males, and our data, therefore, allow 
more detailed analysis qf the effects of race and sex on earnings 
than- has hitherto been possible within a single data set. Second, 
our data allow construction of a block-recursive model ^^at examines 
first the interaction of education and reading skill and, second, the 
'determinants of -wage rate and. labor supply. The economic benefits 
of schooling and literacy skills can thus be decomposed to not 
only their effects on each other, but also on wage rate ^nd- labor 
supply. ThHrd, and most important, our data set includes a measure^ 
of each respondent's basic reading capability. The measure was- 
derived from a set of reading tasks constructed to assess the respond- 
ent's capability to read the kind of material that ^PP^f f J^J^^f^^^ 
in day -to day life in the contemporary United States; it thus differs 
in important ways from 'the ability measures that appear in a number 
of earnings functions. Perhaps its most important difference 15 
that the imparting of reading competence at this level is perhapi 
the foremo-ft single objective stated by public school systems, 
arid over the last decade there has been a massive national effort 
(funded under Title I of the Elementary and Secondary Education 
Act of 1965) directed toward providing compensatory reading educa 
tion for those students who had failed to acquire the basic skills. 
Therefore, in terms of policy implications,' perhaps the P^^^""?^^ 
contributijfeof our paper is to provide a preliminary and necesS^ily 
tentativeMessment of what the narrowly defined economic benef^is 
would be oWarying degrees of success in our nationwide efforts at 
compensatory reading education. 

^ The chapter, is organized as follows: In. Section I we describe 
our basic models and data, ^nd in Section II we present results from 
analyzing our data by way of a standard earnings function. In 



*Mark Bl^urj.R.O. Layard, and George Psacharopoulos made valua 
ble commenTTon an early version of this chapter and ^e authors 
are particularly indebted to -Henry M. Levin for helpful ideas and 
comments*. 



Sections III and. IV we estinjate the block recursive models we fctually 
use to estimate benefits; Section III deals with the labor market part 
of the model and Section IV deals with the schooling-literacy part 
of the model. In Section V we develop our methodology for computing 
total benefits, and. using the. empirical results of Sections III and 
IV, compute the benefits of schoolitig and compensatory education pro- 
grams.' Appendices provide more information about our data, and addi- 
tional results based on some alternative approaches that are mentioned 
only briefly In the main text. 



Models and Data 



- '-^Ti-tMs^^ectlon ve^scribe^flTSlT^e-ljaslTrT^^ coirstd^r 
for analyzing our data, than describe the data ifself Since we have 
no information on a number of the variables that would, ideally, appear 
in an analysis of this sort, we conclude this section by discussing 
some of those missing variables and the implications their absence has 
fDr»'our analysis. 

Models . Figure 1 presents schematically the alteil^ative block 
recursive models we considered. The exogenous variables, those 
variables whose variations are not explained in the analysis ~ sex, 
race, age, and,parents' educations" -- are assumed to ^^^^^^^J^f ^""^^'"^ 
and literacy. We^^resent, however, three ^temative models for this 
process, which are labelled A, B. and C in Figure 1. Models A and B 
are strictly recursive, in that caJsati^^p flows in a prespecified 
one-way direction; in Model A, schooling is assumed to determine lit- 
eracy, and in Modei B literacy determines schooling (on the assump- 
tion that continued success and willingness to stay in school is 
determined at least in part by reading competence). Model U is a 
si^Uaneous one, assuming literacy and schooling to be simultaneously 
determined. Model C thus includes A and B as special ^^^^^ ^f 'J^H 
it not for the problem of identification, our analysis would focus on 
Model C. However, for a variety of reasons, discussed more fully in 
the course of the paper. Mode; A seemed most suitable for analyzing 
our data set; we thus use Model A in the text of the paper; and its 
results are described' in Section IV. In Appendix D though, we 
present two-stage least squares estimates of Model C to be used for 
compajrison with Model A. 

The next major box to the right in Figure 1 schematizes the 
labpr market model. Again there is the problem of whether to develop 
a simultaneous ot recursive model, and again there are three alterna- 
tives which we label 1, 2, and 3, with the obvious interpretations. 
In accord with most studies of labor supply based on survey data we 
end up by assuming wages to affect hours worked but not vice versa 
our labor market results are thus based on Model 1. and our overall re 
suits 'on Model A-1. Estimation of Model 1 appears in Section III. We 
haie again estimated the simultaneous model. Model 3. for comparison 
and the results of this estimation appear in Appendix C. 
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Since Models A and 1 are both recursive, the overall we 
have chosen to estimate is- strictly recursive, greatly simplifying 
problems of identification and estimation. We are mindful of the 
potentiAl distortions this particular specification may have, and 
discuss its specific advantages and disadvantages at a number ot 
po'ints in the chapter. We also point out the direction of bias it 
coul^ induce' in estimating the relative benefits of schooling and 
compensatory reading education. 

Va riables and Data . In recent years there has been a consider- 
able literature examining the effects of education on ^f^^^^^lf?\^^ 
^&f-fcheae- studies r^howeve i, l iav e be cn-based-o u b dmp le s-tfaalr-are-inade 
quate in one or more of the following aspects: small sample size, too 
specialized a sample from which to form generalizations, or inadequate 
measures of education and ability. In general, most studies have been 
concerned with urbafi white males. Only in recent years have studies 
on the earnings of blacks and women begun to be undertaken. For exam- 
ple, studies of earnings of blacks have been made by Weiss (1970) and 
Welch (1973), and studies of earnings of women may be found i^/^fP^ 

- (1971), Hoffer (1973), Woodhall 1(1973) . and Mincer and^^ Polachek (1973). 

m 

The sample data used in the present study, known as the National 
Reading Performance Survey, were collected in 1973 for the U.S Depart- 
ment oi Health, Education, and Welfare through a contract tt> Educational 
Testing Service. There are several major advantages in "sing this sample 
in preference to the others. First, it is a national probability sample 
covering both men and women age 16 and over in all geographic areas. 
Second, in addition to the usual socioeconomic and other background _ 
variables which may determine earnings, data on educational level and 
reading competence are also available. The availability of reading 
competence data £s, for reasons mentioned in the P^"" . 

graphs of the chapter, especially important. Although the effects of 
some measures of ability, such as IQ scores and ^ir Force Qualifying 
Test scores, on the level of earnings have been studied, it is plausi 
ble that reading competence is more subject to the i^^/"^"" . 
schools, and that the study of its effects are, therefore, of greater 
•policy relevance.!. Third, our sample data refer to 1972, more recent 
data than most of the data analysed in ^i""'^""'/"^ 
deserve special attention! Finally, the sample contains information 
that allows us to estimate the labor market segment of the model ot 
Figure 1. 

The general survey design of the National Reading Performance 
Wvey was based on a probability sampling model, uBing households as . 

- basic sampling units. Everyone in the selected household, ^6 years 
of age and older, was to be interviewed. The necessity, of callbacks 
and persistence to -acheive high completion rates was ^^1;^^^^^^^ 
resulted in an overall response rate of approximately 70%. The survey 

. instruments for each respondent consisted of a ^'^^^f /^.^"f J^^j^^ 
questionnaire and one of ten books each containing 17 reading tasks 
Of the 7,866 persons interviewed in the survey, 270 responded only to 
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the demographic questionnaire because they were visually handicapped. 
uAable to rLd the headlines in a newspaper, or simply refused to 
answer the reading tasks. ^ 

The subsample used for the analysis reported in this paper ts 
limited to individuals of age 25 to 60 who reported some earnings for ^ 
1972 and who are either white or black. Furthern«re. individuals on - 
whom information was incomplete were also eliminated from our sub- 
sa^le. As a result of introducing these restrictions the actual 
subsample size used in this study becomes 2.308 individuals. The 
means and standard deviations of variablesinourtotal^^ 
^in^h^o«^«^we-se*^ufesaapl€s are-pr€S€Bted^B^TaW^ • 

t^iTl contains the correlation matrices for the total sample 
and each of the subsaraples. ^ 

As can be seen from the table, in our sample approximately 6% 
of thf respondents are black and 41% are women. The mean age is about 
39 The data also clearly show that men earned, considerably more than^ 
vLn^s a result of working somewhat longer hours at considerably hxgh 
wa^ rates. Years of schooling and reading scores are generally lower 
"r blacks, especially black males. Variables vJKo.e meanings are not 
self-explanatory in Table 1 are discussed further below. 

Y: Earnings for 197!2 reported by the individuals interviewed. 
measured in thousand dollars; 



Wage rate computed by dividing earnings by work hours 



( Y = Y ^ Y, ); 
1 2 



Y : Work hours, measured in thousands of hours worked 
^ during 1972 (full-time workers whb worked all year 
around are assumed to work 2.Q00 hours); 

X,: Reading scores, measured by standardized scores on one 
2 of ten sets of 17 reading tasks administered at the time 
of the survey (the items were all designed to measure 
basic literacy, and thus provide discrimination only 
among those with low reading competence) ; 

X : Potential work experie\»ce. measured by subtractfng 
schooling plus 5, from age - - 

(X3 - X^ - - 5); 

X^: Other income, all family incomes other than those earned 
by the individual interviewed, measured in thousands ot 
dollars; 

X^: Age of individual interviewed; 

X,,: Employment status of theCdividual interviewed (full- 
^° time salaried worker%.= 0, self-employed and part-time 
workers = 1) . 
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Mi.sine Variables . A number of variables that ^« P^^^^^^ ^^^^ 
important determinants of income were not available from Nationa 
SSIng Performance Survey, and their omission raises cautions in 
interpreting our results. Four of the most important categories of 
iisrinrvariables are parental income. -f^^^J^ Ues 
-attributes of the respondent, and occupation of the ^^esponciOTt . 
::riers:; (I974) mention results from a study b H - Lu erman 
and Sewell (1971) that indicate paren s inc^^ ^"^^ f "^^^ ^i.^.t 
independent of their education. Sewell and Hauser (^^2) report 
effects of father's occupation on son's occupation. " 
on son's. Thus our inclusion of only parents' education as a proxy 
SES clearly limit s^ou^jg ialysis* 



A second category of variable missing from our ^f/^f 
measure of school input JMaJitY- ^rly^r. o^ i:.1^:re%:re^Cr- 
ra:t"^:f::rsrru; w;!;; ISd'vfilabl; X -Sly aggregated data from 
whi h " dra; this conclusion. More recent -alyses using r - -ly 
structured earnings functions - Ribich and Murphy ^ 
(197L) - also find positive effects; much of the effect is through 

ifiifluence of quaUty measures on years of «f "^^^^ /^.^f,;::^- 
Both the Ribich and Murphy and the "achtel samples provide informa 
aon onl-y^for males; their samples are further ^P^'^J^^^J^^J^^f ' 
Ribich and Murphy have data only for very recent ^""^^^^ ^° ^ 
labor market project Talent data) and Wachtel only for ^igb ability 

nfividuals (NBER/Thomdike-Hagen data). ^^"^^^ ^fj^i'^/i^f „ 
findings for these limited samples suggests the potential ^alue ot 
I'aminfng school quality measures in a probability sample such as 
ours. ' ^ 

An important school of thought - P^^aps best Presented in 

Gintis (19?1) - maintains that .^^.^^.^^r: fe ^ o • 

schooling and earnings results not from the '^"g" ^^^^^'^^^/^ 
schooling but rather fro,, its effects on personality ^J^les. 
iTnlis persuasively n^kes the -case that "^//f ^ "//^pend- 

certain measures of cognitive outcome, schooling has a strong ^ 
ent effect on earnings. (Our own results, even f 'i',"" 
^o'have an important positive effect -^^^;;^,:trr'How vfr o^^^r ' 

^'h^^^ ^rJfet^enft^t ^aff :c:Se^r L^^s d^"^ ^ 

n^ti ute n i^^ tant fraction of the link between schooling and 
eatings! our analysis must be regarded as seriously incomplete. 

^thir i^S:: h f b^of^rarticular Lncem to sociologists, e.g.. 
Dunca" Feathlrman. and Duncan (1972).. The absence of data on 
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occupation is of particular importance in our study because the dif- 
fering returns to literacy by race and sex may, we hypothesize, 
result from interaction effects of literacy and occupation on in- 
come. We discuss this possibility in more detail later. 

Thus there is a range of important questions that our analysis 
will be unable to address, and lack of information on some of these 
missing variables suggests caution in interpreting our results. Yet 
in spite of these weaknesses, our data 'set has a number of unique 
features that make its analysis worthwhile; most important of these 
are that it was generated from a probability sanple of the U.S. popula- 
t i on, it includes a measure of individual 1 i t_e£a cj^,^^and_jj: ,a 1 l ows ^ _ 
simultaneous study of educational attainment and labor force partici- 
pation. We turn now to our Vesults. 

« 

II, Bnpirical Earnings Function' 

Recent economic literature inquiring into the effects of educa^ 
tion on earnings have generally followed the work of Schultz (1963), 
Becker (1964), and Mincer (1970). Although most of these studies have 
been concerned with the rate of return to education in the United 
States, similar studies have also been made for many other countries; 
for a review see Psacharopoulos (1973). While the primary concern of^ 
the present study is not to* estimate an empirical earnings function, 
we believe it worthwhile to present our earnings function for compari- 
son with the existing literature. There are several important ques- 
tions that we shall attempt to answer in our analysis of empirical 
earnings functions. Among these are the questions of whether the 
earnings functions differ for blacks and whites, or for males and 
females; and if so, in what, way add. ^o what extent they differ. In 
addition, we shall consider some nore sp^ific questions such as whethe 
the returns to education are different for blacks and whites, or for 
males and females. Finally, and central to our study, we shall also 
be interested in the effects of reading competence on the level of 
individual earnings, and these effects vary by race and sex. 

Most empirical earnings functions in the literature have either 
employed a sani-logarithmic or simply linear function, using years of 
schooling, work experience, and the other socioeconomic variables as th 
explanatory variables. Occasionally, squared variables (or oth^r 
transformations) are also included as explanatory variables. In 
general, assuming quadratic specifications, the empirical earnings 
function is generally specified as one of the following two convenient 



forms : 
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or 
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where a's and 6's are the parameters to be estimated (some of them 
may be restricted to zero), k is the nUmber of linear explanatory 
variables, and U and V are error terms, generally assumed to have 
zero mean and finite variance. Using these specifications, and 
applying ordinary least squares for estimation, we have obtained 
the empirical earnings funofrion as reported In Tables 5.2 and 5.3 
where the results of semi-logarithmic and simple linear specifications 
are reported separately.^ 

Psacharopoulas (1973) found in his survey of earnings functions 
no consistent empirical support for eq. (1) over eq-. (2), and the 

lii>ear results can be more easil y understood or interpreted. H owever, 

"^trictTy^speaking, the choice beT:ween the~log^tirear spectflcatrltra 
(eq. 1) and the linear one (eq. 2) cannot be made simply by comparing 
goodness of statistical fit as represented by R^'s. Earlier, Mincer 
(1958, 1972) had advanced a theoretical argument for using eq. (1).^ 
'More recently, Heckman and Polachek (1974), employing a Box and Cox s 
procedure, found eq. (1) to be empirically superior to eq. (2), using 
the 1960 and 1970 Census samples and the 1967 Survey of Economic 
Opportunity Data. For this reason, both empirical earnings function 
of eqs. (1) and (2) are reported. * 

According to both Tables -5.2 and 5.3 years of schooling is 
clearly a significant ' factor affecting earnings. The effects of 
reading scores on earnings are significantly positive only for white , 
males. Apparently the effects of reading competence on earnings for 
blacks, and to some extent for white females, are unimportant. One 
plausible explanation for the differirig effects of reading scores 
across subgroups is that there is a strong interaction between the 
effect"s\of occupation and literacy on earnings. Literacy may be 
helpful In some occupations but not in othersj^nd white males toight 
have preponderant access to the occupations fn which it is useful. 
As our sample contains only poor information on the respondents 
occupation, we cannot test this hypothesis. Nonetheless, if it were 
correct, it would suggest that improving reading scores for, say, 
black females might still have potential economic benefits; realiza- 
tion of this potential would depend on their having better access 
to the appropriate occupations. 

The effects of work experience on earnings are generally posi- 
tive and have a general tendency to decline as the number of years 
and work experience increases. The magnitudes of these effects, 
however, can be estimated reliably only for whites, especially white 
males Although we expect our measure of potential work experience 
may be less satisf actotyHor females whose work experience is more 
likely to exhibit a di%>feJ:lnuous pattern, we did not anticipate the 
considerable difference in the effecte of work experience for white 
and black males that our results indicate.^ Both the effects of 
father's and mother's education on earnings seem to be unimportant 
for all subsamples.^ In some instances, the estimated effects of 
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Bother's education are negative.. .and_in_the caBe_^ black ^^l^^ 
even statistically significant/ The effects of work hours on earnings 
are clearly statistically very significant, especial-ly for whites as 
compared with blacks. The effects of race' and sex on earnings are 
clearly lioportant. Tlidging from the fact that the dummy variables in 
the regressions computed from total sample are statistically signifi 
cant and the regressions of different subsaoples seem to be quite 
different. 7 Finally, since most -studies of earnings functions are 
related to tht empirical estimation of the rate of return, we may 
point out that rough estimates of the rates of return, schooipg, 
according to an approach suggested by Mincer, are provided by ^ 
regression coefficients associated wifh Schooling variable in Table 5. 
rhP »c^^ma1^pH rafPs of ret urn to schooling^ are , .7% and a. 7% 



for white males and females and 7 At and 15.2% for, black males and 
females respectively. Similar estimate^ may be derived from Table 5. J 
by calculating OY/3Xi)Y which also provides rough estimates of the 
rates of return to schooling. « According to this f P"^<^^' ^^J^ ^^^^ 
of return to schooling (at the mean earnings) are 7.4Z and 9-7% for 
white males and females and 9.0%- and 12.4% for black ^^^^ and females. 
We must point out, however, that these rough estimates fail to adjust 
for possible effects of schooling on other explanatory variables, 
such as reading scores and work experience. We shall consider this 
issue more fully later in our discussion of the econoMr benefits 
of schooling and compensatory reading. 

Ill, Labor Marker Analysis; Waee Rate and Work Hours 

The results of empirical earnings functions shown in Tables 5.2 
.r^A S while thev provide interesting information, can be difficult 
L i^;e;preJ for s^m^ purposes, pis is, in part because the effects 
of schooling and literacy on wae/ rate and work hours are i"^^™;?^^^^ 
in eas (1) and (2), and in pa^ because of interdependence of schooling 
and ff^eracy In his sectiSTwe analyse in more detail the structure 
o? tietlbof market, and in The next section we deal with the nter- 

' action of schooling and litelacy. To understand why the fleets of 
Tchooling and literacy are Ip^pntingl^ we must nquire nto the 
meanines of the parameters" and 6's in eqs. (1) and (2). For 

■ si^Ucity. assuming eqs. (1) and (2) are strictly linear in explana- 
tory variables, we can verify that 

a 

i 





( Y/X^ ) p . ( 1 + e ) 
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where 



and 




are the elasticity of wage rate with respect to Xi and the elasticity 
of work hours with respect to wage rate (elasticity of labor supply.). 
Clearly the parameters a's and 6's reflect not only the direct effect 
of exogenous variables on wage rate, but also their indirect effect 
on work hours through wage rate. In this section we shall, therefore, 
analyze the effects of various factors on wage rate and work hours by 
estimating the wage determination function and the work hours 
separately. Ideally, an analysis of labor market should considerboth^ 



separauexy . lukhj-j.} , oii ant^j-^oo-o -^^ . , 

demand and supply factors simultaneously, and one way ot ronmiJ-aixng 
such a model is to consider the wage determination function as the 
inverse demand function for labor and the work hours function as 
the supply function of lab^r.^^ Conceptually the wage determination 
function and the work hours function can, therefore, be regarded a§ 
a system of two simultaneous equations, where Yj^ and Y2 are the two 
endogenous variables. In formal notation, using linear specifications, 
the wage. determination function and the work hours function can be 
written as « 



Yl = 



+ 7 Y2 + u 



(3) 



and 

Y2 = 60 + ^ *i ^ 

where y's and 5's are the parameters to be estimated, and U and V are 
error terms. For identification purpose, some of the parameters Y s 
and 5's must be restricted to be zero. The model as is formulated is a 
simultaneous nwdel because neither Y=0 nor t=0 is necessarily imposed. 
One version of tne simultaneous model has been estimaSied by both the 
Ordinary Least Squares (OLS) and the Two-Stage Least Squares (TSLb^ 
procedures. The TSLS estimates , 'however, have been obtained only 
with an additional restriction in order' to avoid a singular "^trix 
in the second stage of computation. For this reason, in the Jolly- 
ing text only the results of a recursive model (assuming Y=0 and 
57*0) will be examined, and the results of a simultaneous model 
(-f^O and 5^*0) are presented in Appendix C. Notice that in the simul- 
taneous model we assume wage rate affects work hours and vice versa; 
in the recursive model we assume wage rate affects work hours but 
not vice versa. 12 

The empirical results of the wage determination function and 
the work hours function of the recursive model are presented in 
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is an appropriate estimation procedure, and there is no- need to 



is an appropriate estimation proceaure, ana Lnere x» uv,- ..^^^ 
employ TSLS or any other estimation procedure designed for estimating 
the parameters of a system of simultaneous equations. 

The empirical results of Tables 5.4 and 5.5 show that R 's of 
both the wage determination funct-ion and work hours function are con- 
siderably lower than those obtained for the earnings functions. Never- 
theless-, some of the individual coefficients are statistically highly 
significant, especially in the wage -determination function and work 
hours -function of white males. In genera*^ schooling appears to 
be a significant factor in determining wage rates for all subsamples, 
and is also a significant factor in determining work hours of both 

white males and white females. The effects of reading scores on 

^,™-ratB and-worriiOTn^are'^eymyTnsT^ except for a 

negative effect on work hours for black females. There is some 
evidence indicating that reading scores probably have a slight 
effect on wage rate of white males and that their effects on work 
hours are positive for male workers bCit negative foir female workers. 
The effects of work experience on wage rate and work hours appear to 
be more significant for whites than blacks, especially for white 
males. In general, wage rate "appears to increase ^'^Jj. 
but at a smaller rate as experience increases, except for black females. 
Less experienced white males tend to work for longer hours than more 
experienced white males. The same is perhai^T trufe for black females. 
A similar pattern, however, is not indica»:€d for white females or 



black males. 



The effects of father's education ahd mother's education on 
wage rate and work hours appear to be quite different for different 
suLamples. In general, the effects of father's and mother s educa- ■ 
tion on wage rate are negative for white males , perhaps indicating a 
willingness to trade off income for status. 13 The effect of mother s 
e<fbcation on wage rate is negative, for blacks, especially for females. 
The effects of father's and mother's education on work hours are 
eenerally positive, though they are' ususally not statistically • 
significant except the effects of father's education for blacks. 
The effects of father's education on work hours for *hite females is 
neeative and almost statistically significant, a result whose inter- 
pretation does not seem to be apparent. The effect of other income 
on work hours, which corresponds roughly with the effect of wife s 
income and husband's income for males and females respectively, is 
statistically significant only for whites. Nevertheless, ^he -pirical 
results clearly indicate that such an effect is negative as would be 
expected, for the work hours of female workers or the labor supply 
of married women, -rfowever, the effect of wage rate 'on work hours 
is negative for all subsamples, though only the coefficients for 
white males and females are statistically significant, implying a 
strong possibility of backward.-bending labor supply curves. Fi^^^jy' 
the effLts of race and sex on wage rate 'and work hour^ are generally 
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--^;^:^;[iI^I^ir^isUc^^^ the dummy variable for ""/^ ""J 

significant, in the work hiirs iunction computed -from the total sample, 

IV. Determinants of Rdu/aaonal 'Achievements : Ye.ar.s of Schooling 
and , Reading CompetMce , . 

In the previous ^tion the -effects of schooling and reading- 
scores on bo?h wag^e Ite and work hours have been ^^1^-' " Is 
other background variables such as father's and mother s 
well as race and sei. The purpose of this ^f^^^^tJ"^^^^— 
further into the d7terminants ofjrearfi^al--«ehoal^!Tra^^ i^L,-- 
competence, both, W^laraiTls^ernative measures of educa 
^^-i^-l^hievemetyT^ Conceptually the production f^-^^i^" ^PP'^^ff ' 
which has been li(creasingly applied to, educational processes, -may be 
useful. Howeve^. because of the lack of school quality '"jasures in 
our data no at^tempt has been made to follow this approach in the 
follow n^ analysis! Our major concerns in this section are simply to • 
determine what are the sigMficant factors that may affect years of 
schoolijig and reading competence, ifl particular, we shall also be 
concerned with the questions of whether reading "-P«^«^"/^^| unlikely 
determined by years of schooling, and possibly, though perhaps unlikely 
in t^^ present'sample. vice versa. On the present sample the^easure 
of reading competence is obtained years after the respondents have 
left school. 

In; a general form, the educational achievement model may be 
specified as 

■ h " ^o ^-3 + X X2 -H U (5) 

X2 = P,-h'i',.3 V.X^^pXi-h V • ^ (6) 

where X, and X2 are years of- schooling and reading scoVes, and y's 
are the parameters to be estimated, and i includes a given set of age 
and other background variables. The educational achievement ^del as 
specified above is a two-equation simultaneous model. J^-^f ' 

schooling equation and the reading equation are not identified. 
Therefore, some additional restrictions on the parameters- J s and y.s 
^st be imposed. The approach that has been employed in the P^^en^ 
^udy for^dentification purpose is to restrict the parameters associated 
with father's education and mother's education in the schooling func- 
tion to he the same, and also to restrict the parameters of father s . 
education for the white and mother's education for the ^l^ck in the 
reading equation to be zero. These restrictions are somewhat arbitrary 
and are based mainly on judgments derived from the preliminary empiri- 

• T'l reLlts. For this reason the empirical results /jj^^^f-^-^^^: 

• „«del of educational achievements will not be discu sed here They are 
presented, however, in Appendix D. because some of its results are , 
interesting, despite- the possible shortcomings of the identification 
procedure. 
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Radier than examining the empirical results of the simultaneous 
model (assuming X^O and \i40), the following discussion will be limited . 
• to those of the recursive model (assuming X=0 and y/0) that implies 
' schooling affects reading but not vice Versa. ,This recursive model 
\ • is not unreasonable, since our reading, scores are measures of reading 
*■ competence taken after individuals left their schools. Camoy (1972) 
suggested another. type of recursive model, which implies reading 
(or other measures of ability) affects schooling but not vice versa. 
This type of recursive model, as is supported by our preliminary 
empirical evidence, is less suitable fox our sample. 

The actual explanatory variables included in eqs. (5) and (6) 
are father's ediucation, mother's education, age, race and sex. 
Notice that reading scores are not included in eq. (5) but schooling 
is included in eq. (6) in the recursive model to be discussed. Be- 
cause the selected educational achievement model is recursi^^e, OLS • 
can be applied to estimate the parameters of eqs. (5) and (6). It 
HRXst be mentioned that we have treated the estimation of eqs. (5) 
and (6) separately from that of eqs. (3) and (4), partly because of . 
• olir belief in the blockwise recursive nature of our specified models 
and partly because several difficulties were encountered in the simul- 
taneous estimation of our labor market and educational achievement 
models, as was explained earlier. In any event, since the selected 
labor market and educational achievement models. are both recursive, 
the OLS procedure can be appropriately applied to estimate the ■ 
parameters of eAch equation separately. ^ 

The empirical results of the recursive educational- achievement 
model (assuming X=0) are presented in Tables 5.6 and 5.7 for the 
determinants of schooling and reading scores respectively. In general, 
goodness-of-fits as represented by R^'s are reasonable. Most of the 
individual coefficients are statistically significant. The effect 
of age on schooling is statistically significantly negatiye for 
males of both black and white, with numerical magnitude for black 
males considerably larger than that of white males (in absolute 
.values), reflecting the fact that the average increase of educational 
level perhaps has been the fastest for black males. The effect of 
a,ge on reading scores, however, indicates a somewhat different 
interpretation: while younger persons seem to read better than 
the older persons among the white, the same does not appear to be 
true for the black. The evidence is perhaps the strongest for ^ 
white females and the weakest for black females. While both' father s 
education and mother's education appear to have a positive effect 
on schooling, their effects, on reading scores seem to be quite dif-^ 
ferSfft for whites and blacks. ^he effects of father's and mother s 
education on reading are negative and positive respectively for 
whites, but the reverse is true for blacks. For whites it is the 
effect of mother's education' on reading that is significantly posi- 
tive, but for blacks it is the effect of father's education that is 
slgDificantly positive, 'but for blacks it is the effect of father s. 
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education that is significantly positive ^he effect oschooing 
on reading is statistically .significant for all subsamples. but the 
magnitude of the effect is almost' twice as large for b aeks as for 
whUe^. Finally, th^ effects of race and sex - -boolxng and ^ 
•reading appear to be important. This is apparent f torn the ^tatistl 
caL significance of the dummy variables the regression^ based on 
total sample and frbm the differences among the regressions based^ 
on different subsamples. . 



v., 



- R^nefits of Schoolfap and Compensatory Reading 



The purpose of 'this section is to demonstrate how the frame- 
work ^ ou^previous l^bor market and educational achievement J«>d«ls 
Ian be c^biLd to explain the sources of earnings difference, and thus 
how the ?^tal%conom^? benefits of schooling and compensatory reading 
may be assessed-.-^' 

. Most recent ^studies of the rate of return ^° . '° 
estimate an empirical earnings function. using a semi-logarithmic form 
orTs4te linear form similar to eq. (1) or (2) respectively. In 
an early study. Mincer (1958) suggested that the rate of return to . 
Suca ion can'be.esti^ted by th, coefficient of years ^^oo^^^^ , 
in a semi-logarithmic form, and most existing studies seem to^show 
that such an'approach-'can Indeed be useful.' "^'^^-^-^^y- ^^^^^^ ' 
some of the possible limitations of such an approach have become 
apparent. For example, the estimated r^te, of' return to schooling_ , 

be biased because of misSdng variables that are likely. to be 
^rreLte^ with schooling. ^Ul^ches and Mason (197 ) have examine^ - 

-L^Lii^^ific-rioir^^^^ 

recent study t)f black-white difference in retutns to schooling has 
attempted to deal with this pr<^lem by considering a set of anxiliary 
attempted to oeai mterrelationshiDs' among the -explanatory^^ 

lab e hould'be earnings or wage rate and wljether --^^^-"^^^-^ 
be an explanatory variable in an earnings function have been raised. 

' effects of schooling or "other determinants of earnings into the 
effects due to changes in wage, rate and work hours. . 



Although the economic benefits of schooling and reading can be , 

• estimated directly frpm the empirical earnings functions such as \* 
eqs. (1) and (2)', probably with some adjustments as was done by . 
Welch (1973), such ^ri= approach yill not be followed b'ecause, as 

* was policed, out previously, it does mat -provide a framejgjxk for 
id^tifylng whether <?age rate or work hours liiay be the main source 

•of difference in earnings. Therefore, instead of simply relying. on • 
- our empirical earnings function, w^ slWll use the definition of 
, -earnings that is the product of wag6 fate and work hours (Y = Y^X 
■ combined with the empirical fesults^ of our labor market aiHi 

achievement modefs for subsequent discussion. Formally, our analytical 
strudture consists of the definition of earnings, the wage determina- 
tion and work hours functions, i.e., €qs. (3) and (^). ^nd the deter- 
minants of schpoli^g and reading, i.e., eqs. (5) and (6). 

T6 facilitate discussion, we first discuss how the partial 
benefits of schooling and reading or any other factor affecting 
either wage ratfe or work hours may be evaluated, ignoring the inter- 
'relationshlps among the determining factors, such as those examined 
in the educational achievement m^od^el. Lat^r we «hall consider how 

• these partial bmefits may be combined in order to obt&in the fuii 
economic benefits of schooling and reading, using. the empirical 

, relkt'ionships of the educational achievement model. It can be 
verified tl^t the reduced form of the labor market model represented 
by eqs. (3)-and^'(4) is ^ , , ^ - 

. Yi - { l./( 1- oB)}{(-.Oo + ^>^^1.1 («i " \ ^ ^i 

. • - . K^k ^«^i+k>^i'' ^ ' - 



i=l ^"i+k ■ " "i+k 

+ B o, ) X, 



Y2.^ { 1'/ (a - a&)}{ (B^ + B ) + (B^ ■ m , 

/ ' ' . ' ^ -^^i-i <ein- ^^Vk> V },. - 

which -are obtaii^ simply by eliminating Y2 from eqi (3) and Y^ from 
' eq. .(4)/ -TlmsT^oin the definition of earnings, Y = Y^ Y2, the partial 
benefits of any determinant of eamljigs can be written as ■ 



where 




(9) 



and , 
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•according to eqs. (7) and (8). In our , 'Empirical results presented - 
in Tables 5.3 and 5.4, most of the parameters a^+], and ^i+k are 
restricted to be zero, since the only squared variable is work 
ex^riencp. The partial benefits defined above can be clearly 
decomposed into two components Representing wage-rate effect and 
work-hours effect respectiveir. Notice that these partial feff ects 
depend on the specific forms of the wage determination and Work 
hours 'functions. Moreover, they depend on which of the other 
detet^minants are held constant. ^ 

. rn the discussion of partial bSnefits we have treated schooling, 
reading, and work experience in the saihe way as we have ^J^^^^^f ll^l 
exogenous variables such as father'^ educatio^and -the«3 education, 

■which ai;-e cleatly exogenous and beyond the ch^ce of the indivijiuals 
whose earnings are being analyzed.- To evaluate more fully the ^ 

•economic benefits of schooling and reading. ±t is necessary for 
us to take into account some possible interrelationships among the ^ 
explanatory variables that so, far have been treated as exogenous. 
In general, the full benefit of any determinant of earnings can 



be defined *as* 



k , ,„ . V . , . . (10) 



.where (|| ] are partial benefits previously defined in eq. (9). Thus 

full benefits arfe simply weighted sums of partial benefits, dXi/dXj 
being the weights.^ ■ y 

■ Among the many possible interrelationships among the explanaWy 
.variaS th^ important ones are the definition of work expeWe 

Ind the interrelationships studied in our education^fachiev^ent model 
represented by eqs. ,(5) and (6),. Assuming these are the only infer- 
relationships among the explanatory Wiables , specific "Jf^^"'^!^ f 
full benefits of 'schooling and teading can then be computed. From the 
definitioo of work experience as c^. function of age, ^.e. , 
X, = X7 - (Xi + 5), we have dXj/dXi = -1. From the empirical -func- 
tions ol ehe determinants of schooling and reading we know tha.t W 
dXi/dX^ = X and dXz/dXi = y, ^cording to eqs. (5) and (6^ re^pec 
tiiely! Therefore the full bene^ts of schooling and ^^^^-^-J^^^' 
^tence measured in "terms of incremental annual earnings may be defined 
explicitly ^ as * . 



and 



(11) 



(12) 
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where in both cases the first term represents the benefits attribut- 
able to schooling and the second term to reading, Thei^efore, the 
first term in eq, (11) and the second term in eq, (12) may be 
..regarded as direct benefits of schooling and reading competence, 
and the second term in eq, (11) and the first term in eq, (12) 
their corresponding indirect benefits- Notice that, in general, 
the^ benefits are functions of age, schooling, and other background 
varSbles., since partial benefits are functions of wage rate and , , 
work hours. ✓ 

Full be^fits of schooling and reading competence as defined 
in eqs. (11)' and (12) can be expanded and rearranged as 



(fr) 




{(t) 

{(t), 

Hit) 



fe)-tit)). 



.(13) 




Mit)}' 



(lA) 



where the ffyatr ^rms are t ll& effects of wage rate on full benefits 
of schooling and reading, and the second terms the corresponding 
effects of work hours. The decompositions -of full benefits of 
schooling and reading into wage-rate and work-hours effects as 
suggested in eqs. (13) and (14) are not only usefiTL in themselves 
but also convenient in order to compute some-45ther measures of 
benefit. For example, similar to Eckaus (1973), alternative 
measures of benefits may be computed by assuming work-hours ^re 
fixed at the same level for all individuals. Thus, adjusted 
benefits of schooling and reading competence may be coii5)uted by ., 
dividing the first t««ns of «qs, (l^-and.-(X4.) hy. the ratio of 
observed work hours to the fixed, say 2,000 hours, and ignoring 
the second terms representing the effects of work hours. An Im- 
plicit assumption used /in these measures is that individuals always 
work full time, either in the. labor maH^, as self-employed, or In 
household production. These measures of Adjusted benefits,^ though 
they clearly have some limitation, may be useful especially In 
indicating maximum benefits of schooling or reading. 

So far we have discussed benefits of schooling and reading 
only in terms of Incremental annual earnings. We have pointed 
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out these benefits are in general functions of age, schooling, and 
other background variables. By holding\all other variables constant » 
for example, at the observed mean levels' and letting only age vary, 
we can construct a stream of annual earnings Increments realizable 
at any given age due to an incremental change in schooling of reading. 
The present value of this stream of benefits, discounted at some 
appropriate discount rate, provides a more complete measure of the 
economic benefits of schooling or reading. Formally the present . 
values of full benefits of schooling and reading may be, computed 
from 



(15) 



-r (X7 -n) 



(16) 



/m /dY \ 

n 

where n is the current age and m is the retirement For practical 

purpose, the present values of full benefits of schooling ^nd reading 
* may be computed by discrete approximations of «!qs. (15) and UbJ , so 
that indefinite integration may be avoided. 

t 

Finally, it must be pointed out that benefits of schooling and . 
reading previously discussed are all marginal benefits r^lecting 
•' changes in benefits due to changes in one unit of schooling or ^ 
reading (evaluated- at a given schooling or reading lev^l). The 
total benefits of schooling or reading, measured in terms of annual 
earniiigs, due to changes over several uqits of schooling or reading 
can also be computed as 

/I (il) d^i . (17) 



and 



n 



dX, ' ' . (18) 



where n and m are the initial schooling or reading level 4pd the 
targeted schooling or readiiig level "^P^^^J^^^y ' .^1^^!^' ""^ 7/ 
spondipg average benefits are obtained simply by dividing eqs (17) 
and (18) by m-n," representing the range of change in schooling or 
read ng These measures are particularly useful ^o answer such ques- 
"ons as: what are the possiUe economic ^-^Jl^^^^/.^^^J^X'^ 
level of schooling from n years to m years or the level of reading 
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competeftce from n to o standardized score? Given the distribution 
of the ^airtH schooling or reading competence, the possible bene- 
fits'?^ given educational program that would raise the schooling 
or reading. level of all individuals to a given targeted schooling 
or reading level can also be computed. For example, we can compute 
the econ6mic-\enefit of a compensatory reading program that would 
'■'•U raise the reading competence of all individuals whose scores are 
under a given targeted level, say, the present national mean (zero 
- in standardized scores). Although we have discussed the concept of 
•Jl^' aveiage andXtotal benefits only in terms of annual earnings, these 
ariSTconceptk can be applied to the present values explained in 
•t^'eqsT-' (15) and\(16)-. That the numerical value of such a computation . 
should be used with extreme caution goes without saying. One is , 
% both extrapolating from marginal to large changes and ignoring the 
? poSffibility of non-optimizing producer , choice or market signaling 
Ufffecis fSpence, 1974, Chapters 3 and 4) . Nonetheless, we feel the 
Vomputanons do place a rough upper limit on the total benefits to 

expeSed. The empirical results of the benefits of schooling 
and reading- based on the concepts discussed above are presented in , 
Tables 5.8'and 5.9. The results presented here are based on the 
empirical relationships given in Tables. 5. 4 through 5.7 assuming 
recursive structures for bqth labor market and educational achieve- 
ment models. It should be noted that, since our assumed recursive 
structure has schooling affecting reading, hut not vice versa, 
there may be some tendency to overstate the reUtive benefits of 
schooling and understate those of compensatory reading education. 

In Table 5.8, the estimates of alternative measures of private 
benefits of schooling are presented. The table is divided into two 
parts: the first part gives the estimates of alternative measures 
of marginal benefit for an additional year of schooling at approximately 
the high school level, and the second part provides the estimates of 
total benefits for a representative individual- and the nation as a 
whole for two hypothetical compulsory educational programs. The 
estimates of partial and full benefits-of f ^ff^ff^f" 

eqs (9) and (11), are computed at the mean levelff of all explanatory 
variables. , In general, thede two measures are very close (to each 
other with full benefits somewhat lower than partial benefits 
lar'gely because of adjustments for foregone benefit due to experience. 
The estimate'd full benefits, measured in terms of increases in annual 
earnings, are the highest for white males ($1,121) and the lowest . 
for white females ($517). The Corresponding full benefits for 
black males and females are $663 and $783 respectively. When the 
full benefits are decomposed according to eq. (13) into the wage- 
rate and work-hours effects. It is apparent that most effects are 
due to wage rate rather than work hours. It; is interest^g to note 
that most estimated work-hour effects are negative, excajt yhite 
females. The estimated adjusted benefits, similar to Eckaus (1973), 
are computed by dividing the first terms of eq. (13) by the ratio 
oJ ac^^rk hours to full-time work hoixrs (2,000 hours). Because 
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the fatios of actual work.hours to ^^1^^^%^ 

to one, and the work-hour effects are generally small, the results 
of adjusted benefits are not very different from the corresponding 
original estimates of full benefits. The present values of full 
benefit streams are computed at age 18, assuming ^ement at 
age 65. The effect of dispount rate on the magnitvi^e of P^sent 
value is shown by providing results for zero, 5% and ^^^J^l^l^' 
rates. It is important to note that the f resent values with 10% 
discount rate are perhaps very close to the mean ^^"^^f 
individuals at age 18, suggesting that the private 

to schooling are approximately except for black females whose . 

rate of return to schooling appeats \o be somewhat higher. 

The estimated total "benefits of two hypothetical compulsory 
,educational programs must be received with f , ^_ 

estimated benefits are based on the assumption that all Individuals 
(age 25 and over) whose educational levels' are lower than the 
targeted level (either high school or college graduation) were 
able to complete the compulsory education at the targeted level, 
arid that they were able to oht^ the l^^^^'^ll^t^lll'lllZed 
observed for the targeted levels of schooling It 
' that no benefit (or loss) will occur to individuals "^ose level of 
schooling are already above the targeted level. The 
for a representative individual of the hypothetical compulsory 
educational programs are computed by 



/m 
o (dXi) 



f(Xi|Xi<m)dXi . • - ^^^^ 



where f(Xi|Xi<m> is the conditional- distribution of individuals by 
:Sucationll level, and m is either 12 or 16, ""-J^^ f^^^.J f 
school and college graduation respective y. ^^^^^ 
are in effed^ measures of average benefits of all individuals whose 
education is under the^iven targeted l^vel. As the tab e shows 
the estimated benefits of the hypothetical compulsory high school 
education for a representative individual are the highes for 
white males ($3,810) and th^ lowest for "JJ^e females ($1,370). 
The corresponding estimatedf benefits for bUck males fem^es 
are $2,580 and $1,940 respeHivelj. The estim^ited benefits the 
hypothetical compulsory- colleifldifc^tion for a "P"^^^""'^^;^ , 
individual can be interpreted analogi)usly. Fi-nally,^ the national 
pfog^^m^enef-its ^re computed simpl? by multiplying the representa- 
tive individual benefits by the cori/esponding total numbers of 
iilividuals completing less th.n, hieh school or f/^^f -f3^°J^- 
The actual figures used for the numtprs of individuals (age 25 and 
over) completing less than high school or "^^^8^,^^""^ i^%?"",3 
for 1970 taken frpm the 'Statistical Abstract of the Unit^ States 
1972 No.' 168. As the table shows, the estimated national program 




benefits of the hypothetical compulsory ^igh school e^Jucation are 
substantial: approximately $76 billion and 40 billion for^^^^^ . 
naies and females and $8 billion and $7 billion for black f^^^J 
and females respectively. The estimated national program ^enefits 
of the hypothetical compulsory college educatiop Jffher . 

It must S recognized, however, that practically such hypothetical 
programs cannot be realistically implemented. ^ 

We have so far discussed only our esttmates,of benefit^ of 
schooling as shown in Table. 5.8. The corresponding «f ^^"^ 
benefits of reading competence are reported in Table 5.9. which is 
also divided into two parts: marginal benefit and toyl baiefit. 
The estimates of partial and full benefits, as defined in eqs- 

• (9) and. (12). are also computed at the mean levels of all explana- 
tory variables. The partial and full benefits, shown under the 
heading of marginal benefit, are identical because the underlying 
educational achievement -model is recursive, i.e.. X-0 in ^^' \^JJ' 
As the table shows, the benefits of reading competence for males ^are 
larger than for females. In fact.. our result shows that the. benefits 
orrTadilircompetence is negati:,e for^ack females. ^Whether his 
result can be taken seriously is. however, not cl^r to us. It is 
i^;^rtant to note that when full benefits are decomposed according 

to eq.. (14) into wage-rate and work-hours effects, we find that 
the wage-rate effect is more important for white males but the 
^^k-hours effect is «>re important for btack males. In addition f 
it is interesting to note that the wage-rate and work-hours effects 
arein oppositrfirection and aln«st cancelling the ff-ts of each 
other completely for white females. The interpretation of the 
estiLtS adjusted benefits and .present values at various discount 
rates are analogous to those of Table 5.8. 

In the second part of table 5.9. the ^-t^^^^^ 5°^^!^^"!' ' ' 
of two hypothetical compensatory reading program?, with low and 
high reading-targets, are provided. We must stress that these 
estLtes. like the similar estimates for the two hypothetical • 

• co^sor; educational programs gi>.en in Table 5.8. "-f^^^/^^^J^^. 
l±7h great caution. The total benefits for a representativeindivid- 

-Sl of the hypothetical compensatory, reading programs are confputed 
by . . 



vrfiere f(X,lX2<m) i's the conditional "distribution of individuals by 
SarSld%e;ding score, and m is either -1 or ""^P^ff ^ 

to a 16w or high target compensatory reading program. As the table 
sLSs the estLted benefits of the low target compensatory reading 



program for a representative individual are $3 3 and fo^lte 
LlL and black n^ales respectively, and only f2 for white emales 
and negative for black females. The estimated benefits of the 
high target compensatory reading program for ^ "P"f 
individual are somewhat higher as inay be expected, except for 



black females. 




The national prJg?^ benefits are computed by ^/P^yJ^.^^ 
representative individual benefits by the corresponding estimated 
numbers of individuals whose reading competence, measured by 
standardized scores, are likely to fall b.low -1 or --'^^^^f 
the frequency distributions of the National Reading Performance Survey 
and population figures (age 25 and over) for 1970 obta^ed from 
Statistical Abstract of the United States 1972 , No. }f ' 
benefits of a national program which raises everyone ^ 
petence to a lev^l represented by -1 of standardized riding score_ 
are estimated to be approximately $2 billion and $71 
respectively for white males and females and -PP'^"^^^^,^, ^ 
Lllion and negative respectively for black males J^^^^; . 
The estimated benefits of the high reading target na ional program 
are: as expected, generally higher. Their i^^'^P'^^f^^^^^^.^^^iy ' 
analogous, and. therefore, need no further explanation Fi^^^ly- 
S/wifh t; emphasize again that these estimated benefits are very 
tentative They may be biased downward for one reason, but biased 
u ;lrd ^or another reason.18 Purth.rmore. like ^^^^^^^^f ^ 
compulsory educational programs discussed Previously. f ^J^^^, 
of th^ hypothetical compensatory reading programs may be practically 
infeasible to achieve. ^ 
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FOOTNOTES 



We are aware of only a few prior .studies dealing with the rela- 
tion between literacy and earning. One is by Camoy and 
Lockheed-Katz (1971) using Brazilian data; while they had insuf- 
ficient information to specify an earnings function, they did 
find a positive association between literacy and earnings. 

See R. Murphy (1973) for a detailed discussion of how the 't^ 
instruments were developed and implemented. 

One series of studies of correlations between personality 
variables and income, though restricted to graduates of the 
Master of Business Administration (MBA) program of the Stan- 
ford Graduate School of Business, does provide direct support 
for the Gintis position. Harrell (1969, 1970) and Harrell 
and Harrell (1974) found that high earnings MBSs tend to have 
more, "ascendant" personalities and were "...overwhelmingly 
' in the socially desirable direction on the personality ^^asures 
(Harrell, 1969, p. 46l>. Harrell and Harrell found a significant 
negative (simple) correlation between verbal score an^ earnings 
of MBAs, and attributed this to differeaces they found in per- 
sonality. It would be of interest to ascertain the extent to 
. which this finding would hold up in a multivariate (i.e., earning, 
function) analysis. 

Although experience-squared is included as an explanatory var- 
iable in our estimations, eq. (2) is referred to as simple 
linear for convenience. In our early analyses, we ^^^^^^i- 
mated the earnings function with cross-product terms attempting 
to explain the interactions between schooling and reading and . 
between experience .and reading. According to the results ot 
semi-log earnings function, most of these interactions are 
positive. While the experience and reading interaction is 
mo're significant for white males, the schooling and reading 
interaction appears to be more significant for white females 
as well as for blacks of both sexes. 

The term "work experience," throughout the-present study, should 
be understood as potential work experience as previously defined. 
For males, potential and actual work experience are probably 
very close; females, however, after marriage, spend less than 
half their lifetime in the labor- market on the average, and our 
.data^ra unable to provide information on the actual amount. ■ 
Mincer and Polachek (1974) have , used the National Longitudinal 
Survey data to estimate the effects of actual labor market 
participation on women's earnings. 
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6, This result is in general consistent with the evidence provided 
by existing studies which indicates- that the most important 
parental influences on the adult earnings of their children 
are indirect rather than direct. Thus, the effects of parents' 
education on schooling, and, to a lesser extent, literacy 
does make a contribution to future earnings-, but the effects 
can be traced only through estimation of the type of recursive 
system estimated later in this paper. Tor review of some 
of the existing literature, see C.R. Hill and^F,P, Stafford 

/ (1974)- 

e 

?• More rigorous testing procedure along the line suggested by 

Chow. (1960) has not been performed. Our maintained hypoth- 
esis is that each subsample should be represented by an earnings 
function of its own. 

* * • , 

8. This is because the rate of return to schooling, according to 
eq- (1) suggested by Mincer (1958), is 3lnY/9Xi which equals 
(3Y/3Xi)/Y. 

9. Our results are thus consistent with those of Welch (1973) - 
that returns to education are now as high for blacks as whites. 
This is in contrast to earlier findings, but the more recent 

- data used by Welch and by us suggests that there has. been a 
change over time. 

10 This simply reflects a particular normalization rule. The 
idea has been indicated by R. Hall (1973). No satisfactory 
empirical result, however, has been provided. 

• 11. Although the same notation is used for the error terms of 
eqs. (1) and (3), and similarly for eqs. -(2) and (4), they 
are in general different. 

• 12. These problems of identification are standard in the labor 

supply ],iterature that uses survey data; see, for discussion, 
the papers in the volume edited by Cain and Watfs <1973) or 
Met'calf, Nickell, and Richardson (1974). 

13. Henry Levin suggested the potential importance of this trade- 
off to us. 

14, In preliminary analyses we constructed, as an alternative to 
mother's and father's education, a measure of their education 
relative' to what the education of a person their age would be, 

• using a prediction of their age iaaed on the respondent's age. 
This transformation affected the results in no substantial or 
consistent manner, so we returned to the more simple education 
variable, ^ 



J 2 



15. Recall that the reading scores were constructed as standardized 
scores," since ten different test booklets were administered. 
More specifically, the reading scores are defined as {V^ - I'j)/i>j. 
• where is the pro£ortion of right answers for i individual 
using j booklet- and P. and are mean and standard deviation of 
P.,. These standardised scopes were based on all items in each 

■ bJ^klet. Our supplementary study on the possible ff^^^t ^f de- 
leting some "inapiftropriate" items on the results of our analysis 
indicates that such an effect can be expected to be relatively ^ 
minor, since the correlations of standardized scores based on 
all items and "selected items" only are highly correlated. 
Transformations of reading scores were also experimented with. 
In particular, a transformation of reading score was defined 
as -N^4 (1 + k)*'^^ where N.. is the number of wrong answers 
for thi i indivMMal usingi booklet divided by the ratio of 
the mean of theTumber of wrong answers for j booklet to ttiat 
of all booklets, and k is a given constant, which was assigned 
a value ranging from -0.5 to 0.5. The results """P°"^^f , . 
to eqs. (5) an? (6) generally suggest that there is no significant 

. difference among alternative transformations of reading scores. 
In addition, in Appendix B, we also examine the effects of 
substitUtipg discontinuous variables for schooling and reading 



scores. 



16. . For the results of some other studies on the ^^1^%°^ 

■ education on schooling, see C.R. Hill and P.P. Stafford (1974) 
or Woodhall (1973, p. 288). 

17. The analytical framework developed here may have other Potentially 

■ significant applications, for example, in analyzing ^n important 
issue on the sources of inflation and ^eal economic growth The 
analogy between tW^roblem and the one discussed in the text 
is appar^t, since inflation and real output correspond to 

wa'ge and work hours respectively. 

18 For example, these estimates of total benefits of reading com- 
petence may be biased d^ownward because of our imposed assumption 
of "linear" effect, a possibility examined more fully in our 
Appendix B. On the other hand, these estimates m4y be biased 
upward because of -our failure to consider the ia6ue in a gen- 
eral equilibrium framework. 
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- TABLE 5.1 , 
SAMPLE MEANS AND STANDARD pEVIATIONS OF VARIOUS SUBSAMPLES IN NATICWAL READING SURVEY, 1972 
/ (AGE 25 to 60, WHITE AND BLACK) • 







Total 


White 




Black 


• 


Variable 




. Male 


Female 


Male 


Female 


Y 


Earnings (thousands, of„ 
dollars per year) 


9.597'3 
(6/2233) 


12.59?1 
(6.0149) 


5.7527 
(4.1263) 


7.6585 ' 
(4.1986), 


5.2938 
(2.7634) 


LnY 


Earnings (log) 


1.9967 

' (0.8155) 


, 2.3982 
(0.5655) 


1.4660 
(0.8160) 


' 1.8660 
(0.6306) 


1,4862 
(0.6688) 




Wage Rate '(dolldrs per 
hour) 


5.4595 


6.7177 

\J* V^OZ } 


3.9292 
(4.2174) 


4. 1087 
(2.0859) 


. 3.0780 
(1.5818) 


^2 


Work Hours (thousands 
of hours per yeajfc) - 


1.7953. 


1.9297 


1.6003 • 
(0. 5978) 


1.8481 
(0. 3729) 


1.7577 
(0.4699) 


V 

^1 


ocnooiing vyears^ 


• 12.7943 


12.9966 


12.6636 
(2. 5217) 


11.1081 
(3.1610) • 


12. 5001 
(2.5892) 


V 

^2 


iweaQing vSLanaarai^ea 
score) 


-0.0001 
(1.0D03) 


0.0627. 
(0.9655) 


0.0580 

\\) . 07 LL) 


-l.]?459 


-0. 7685 
(1. 3172)^ 


Y 


ITvY^o t" 4 It* O 1 Vf O O T" C O 1 

iLxpcrxcntjzc vyt:»t£> ui 
potential job experience) 


21.5528 
(11.1516) 


21.0706 
(11.0995) 


(11.1426) 


21.6378' 


21.0488 


Y 2 


Experience-squared , 


588.8828 • 
(526.4469) 


567.1686 
(522.6717) 


620.294^ 
(521.6531) 


613.2794 


557.1324 




Father's Education 
(years) 


9.0333 
f4 -21951 


8.99^2 


9.2169 
(4. 1228) 


7.8690 
(3.4863) 


8. 4834 
(4.3956) 




Mother's Education 
(years) 


9.3382 


9.S932' 
U« 8704) 


9.3296 
(3. 700») 


8.4974 
(3.4604) 


9.3252 
(3.6612) 


h 


Other Income (thousands 
of dollars per year) ^ 


» 8.^233 
(12.0290) 


6.2262 
(11.4253) 


11.3307 
(12.5611) 


' 3.2470 


7.0111 
(10. 7111) 


» 


Age. (years) 


39.3472 
(10. 26750 


39.0672 
(10.1515) 


39.9378 
(10. 3722) 


37.7460 
(10.4891) 


38.5488. 
(10.3696) 


h 


Race (blkck = 0, 
white = (l) 


' 0.0589 
(0.2355) 












Sex ({eSie = 0, 
male = 1) 


0.4131 
(0.4924) 






•> 






Employment Status (part- 
time-Qj^^ full time^^) 


0.2998 
(0.4582^ 


0.2168 . 
(0.4121) 


0.4315 
(0.4953)-^ 


0.1744 
(0.3795) 


0.2709 
(0.4444) 




Number of Observations 


2308, 


1287 


891 


73. 


57 



/ 



ERIC . . - .ij 
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-• TABLE 5.2 



REGRESSION RESULTS OP* SEMI7LOG EARNINGS .FUNCTION 



a,b 



Explanatory 
Variable » 


Total 


/ White 
/Hale 


* 

Female 


Black / 
jiale Female 

» 


Scnoollng 


0.0822 . / 

(20.78) / 

1- 


0.0765 
(17.24) 


0.0874 
(10.48) 


. 0.0743 
(3.24) 


0.1515 
(6.07) 


Reading 


0.0484 
(4.68) 


0.0590 
(4.67) 


0.0339 
(1.68) 


- 0.0261 
(0.73) 


-0.0011 
(-0:02) 


Experience 


0.0293 0.0474 
(8.40) (11.32) 


0.0079 
(1.22) 


0.0178 
(1.06) 


0.0033 
(0.14) 


Blxperience-sqtiared 


-0.0005 ' 

(-6.20) ; 


-0.0008 
(-8.84) / 


-0.0001 
(-0.44) 


-0.0003 
(-1.05) 


-0.0001 
(-0.13) 


Father's Education 


0.0004 
(0.13) - . 


0.0005 
(0.14) 


0.0012 
(0.22) 


0.0130 
(0.67) 


0.0143 
(0.76) 


Mother's Education 


0.0031 
(0.98) • 


0.0045 
(1.22), 


0.0041 
(0.67) 


(-0.45) 


(-2.41) 


Work Hours 


0.8642 ;' 
(42.33) ] 


0.7529 
(18.78) 


0.8973. 
(33.23) " 


0.8761 
(6.91) 


0.7176 
(B.15) 


' Race 


-0.1560 
(-4.02) 










Sex 


-0.6198 
(-32.37) 






1 




.Constant 


' -0.7384 


-0.6544 


-1.2656 


-6.7556 


-1.3414 




(-9.48) 


(-6.06) 


(-9.18) 


(-1.90) 


(-2.88) 




'0.6O93 . 


0.3528 


^ 0.5055 


,0.5216 


0.5210 • 

vL.n 


F 


577.14 143.72 


187.18 


15.36 



^The dependent variable is the log of the nuod>er of thousands of dollars 
ol annual earnings. 

b » ' * 

t^values are expressed in parentheses below paranfSt^i^estimates . 
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TABLE 5.3 

REOlESSKMi RESULTS 'OF LINEAR EA&NINGS FUNCTION % 



Explanatory , - White Black 

Variable Total Male Female Male Female 



0.8087 0.9321 ■ 0.5550 0.6889 . 0.6580 

(23.63) • (19.22) - '(11.39) (4.10) (5.90) 

'0.2903 f' 0.4699 0.0311 0.1274\_^.0824 

(3.24) (3.39) (0.26) (0.49) (-0.37) ' 

0.3651 ' 0.5455 - 0.0891 0.0960 0.0409 

(Izi.OS) (11.87; ^ (2.35) (0.78) (0.39) 

-0,0058 -0.0088 ^ -0.0011 -0.0010 -0.0004 

(-9.19) , (-9.08) (-1.37) (-0.45) (-1.89) 

Father 's Education 0.0263 . 0.0193 0.0365 O'lSSS- " 0.0811 

(1.'07) (0..53) (1.17) (1.12) (0.97), 




Mother's Education -0.0175 -0:0064 0.0016 -0.1254 "0.1671 

(-0.64) (-0.16) (0.05) (-0.84) (-1.74) 

. 3.7545 5.3516 3.3272 3.607i 2.1396 

t (21.25) . (12.18) (21.09) (3.88) (4.10) 



Work Hours 



Race / -1.7205 

/' C-5.12) ' 

* [ ' 

Sex , -5.3440 — 

\ ' (-32.24) 

Constant "-9.7003 -16.5161 ^'^ "8.2620 -8.1316.-6 5195 

(-14.39=) (-13.95) (-10.25) (-2.79) (3.13) 



Q.4974 0.3123 0.3400 0.4218 •.0.4395 

( ' 
F 



366.20 119.73 94.35 10.28 9.21 



^The dependent variable is ihe number of thousands of dollars of annual earnings, 
''t-values are expressed in .parentheses below parameter estimates. 
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TABLE 5.4 



REGRESSION RESULTS OF WAGE DETgjtklNATIoll FUNCTION 



Explanatory 
Variable 



Total 



White 



Male 



Female 



Black 
Male Female 



Schooling 

Reading 

\ 

Experience 
Experience-Squared 

Father » 3 Education 
Mother's E$i,ucation 

X 

Race 
Sex 

* 

Constant 



0.5678 
(16.76) 

0.1025 
(1.16) 

0.2250' 
(7.53) 

-o:oo38 

(-6.07) 

-0.0248/ 
'(-1.02)/ 

-0.0588 
(-2.15) 




0.6724 
(14.81) ^ 

0.1813 
(1.40) • 

0.3058 
(7.16) 

-0.0051 
(t5.68) 

-0.0655 
(-1.94) 

-0.1019 
(-2.68) 



0.3306 
(5.55) 

0.0459 
(0.32) 

0.1198 
(2.58) 

-0.0020 
(-2.08) 

0.0425 
\l.l2) 

0.0457 
(1.05) 



0.3919 
(4.23) 

0.0355 
(0.25) ■ 

0.0679 
(1.00) ' 

-0.0009 
(-0.70) 

0.0580 
^ (0.76) 

-0.0730 
(-0.89) 



0.4535 
(7.16) 

-0.05Z1 
(-0.42) 

-0.0031 
(-0.05) 

0.0002 
(0.14). 

0.0353 
(0.75) 

-0.1520- 
(-2.79) 



-2.4999 
(-4.21) 



-4.0333 
(-4.85) 



-2.4904 
(-2.64) 



-0.9569 
(-0.67) 



-1.5405 
(-1.34) 



R 
t 



0.1794 
91.07 



0.1454 
52.37 



0.0529 
11.95 



0.2804 
6.47 



0.4397 
1(^.88 



^Thfe depeii^dent variable i,a wages expressed in dollars per hour, 
^t-values ar& expressed in par^theses below parameter estimates, 
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TABLE-5.5 

REGRESSION RESULTS OF WORK HOURS FUNCTION ^'^ 



* Explanatory 
Variable 


Total 


Male 


White 

Female 


Black 
Male Female ' 

> 


Schooling 


0.0152 
(4.39) 


0.0063 
(2.39) 


0.0246 
(2.86) 


-0.0018 
(-0. 09) 


0.0404 


Reading 


0.0001 
(0. 01) 


0.0058 
(0.84) 


-0.01129 
(-0.64) 


0.0289 
(1.01) 


-0.0833' 
Q-i. oh; 


Experience f 


0.0139* 
(4. 76) 


0.0178 
(7.64) 


U 

0.0051 
(0.77) 


0.0020 . 
(0.15) 


.0.0265 
(1.21) 


Experience-squared 


-0.0002 
(-3.14) 


-0.0003 
(-6.42) 


^ 0 

(0.22) 


0 0001 
(0.23) 


''-O.OOOS 
(-1.U8) 


Father's Education 


-0.0008 
* (-0.33)* 


0.0018 
. (0.99) 


-0.0071 
(-1:33) 


U* UJUO 

(1.98) 


U. UJUo 

(1.72) 


Mother's Education 


0.0024 
*(0.90) 


0.0011 
(0.52) 


0.0029 
(0.47) 


0.0071 
(0.44) 


0.0049 
(0.22) 


Other Income 


-0.0011 
(-1.62) 


0.Q014 


. -0.0034 
, (-2.55) 


' 0.0065 
(1.14) 


-0.0006 
(-0.10) 


If a^e 

Race 


(-12.81) y 
.0.0044 

(o;u) . 


— n m 7ft 
(-13.96) 


r 

(-7.77) 


• -0.0082 
(-0.41) 


-0.0653 
(-1.57) 


Sex / 


-0.3704 











Constant 


1.6779 
(28.86) 


1.7342 
(38.01) 


1.3547 
(10.10) 


1.5319 
(5.25)»- . 


0.8218 
(1.87) J 




0. lli48 


0.1172 


0.0645 


N 

0.1498 


0.162 




.65.681 


30.60 


11.05 


2.15 


1.72 








— : — V- — 


J 





The depei>4ent variable is the nun^er of thousands of hours the respondent 
worked fa. 1972. ' ' • • 

''t-values-are expressed in : parentheses below parameter estimates. 
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TABLE 5.6 

REGRE§SIOlJ RESULTS OF DETERMINANTS OF SCHOOLING a,b 



Explanatory • ' White Black 

Variable ' Total Male Female Male Female 

Father's Education 0.1776 0.1903 0.1724 0.1769 0.0573 

(13.25) (10.04) ' . (9.21) (1.87) (0.72) 

Mother's Education 0.1856 0.1488 0.2168 0-.3811 0.2715 

(1Z.28) (6.94) . ' (10.19) (3.93) (3.00) 

Age ^ -0.0149 -0.0186 -0.0618 -0.0868 0.0309 

\ (-3.38) (-2.86) (-ll'^a)'^ (-3.89) (1.18) 

Race -0.8637 — 

(-4.71) 

Sex -0.2570 

(-2.94) ' - ^ 

Constant 10.1987 10.6111 9.3639 9.7532 8.2909 

(42.38) ' (30.50) (28.35) v (8.69).^ (5.98^ 

0.2402 0.19^7 0.3090 • 0.4640 0.1883 

F 210.80 149.09 191.65 ^ 29.62 6.66' 



^The dependent variable is the number of years of schooling attained by the 
respondent.' 

b ' ^ 

t-values are expressed in parentheses below parameter estimates. 



ERIC 



1 



-110- • ■ 

* ' TABLE 5.7^ 

REGRESSION RESULTS OF DETERMINANTS OF READING 



Explanatory 
Variable 

\ 


Total 

* * 


White 
Male Female 

♦ 


Black 
Male Female 


Fathers Education 


0.0001 
.(0.02) 


-0.0037 
(-0.60) 


-0.0122 
(-1.65) 


0.1134 
(2.20) 


0.1612 
(4.35) • 


Mother's Education 


0.0322 
(6103) 


0.0430 
(6.36) 


0.0270 
('3.21) 


-0.0527 
(-0.95) 


-0.1367 
(-3.10) 


Schooling 


a. 1331 
(22.24) 


0.1274 
(17.60) 


0.1382 
(12.99) 


0.2142 


0 . 2070 


Age 


-0.0029 
(-1:92) 


-0.0026 
(-1.27) 


-0.0051 
(-2.24) 


0 .0227 
(1.78) 


0.0004 
(0.03) 


Race 


-0.8759 
(-13.79) 


N 1 ■ . 








Sex 


0.0517 
(1.71) 










• 

Constant 


, -1.8590 1 
(-18.02) ■ 


-1.8639 
(-14.04) 


-1.6296 
(-10.15) 


-4.8244 
(>-6.10) 


-3.4641 
/ (-4.53) 

1 




0.2637.^ 


0.2389 


0.1979 


0.2859 


0.3330 




199.02 y 


145.12 


79.28 ^ 


10.17 


10.63 



The dependent variable is. the respondent's standardized reading score on a 
literacy test. 



/■ 



t-values are expressed in parentheses below the parameter estimates, 
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i . / TABLE 5.8 

ALTERNATIVE MEASURES OP" BENEFIT' OF SCHOOLING 

S 



White - Black 
Total Male Female fjale Female 



I. Marginal Benefit? 



II. 



Partial. Benefit 


$ 1,042 


9 1 , ^ / O 




9 /Uo 


9 OO J 


Full Benefit 


931 


\ 1 191 


'^l 7 


00 J 


7Q 1 


Wage Effect. 


939 


1^ 1 RA 
X , 100 




AQ7 
00 / 


805 


Hour Effect 


-8 


-65 


35 


-23 


-22, 


Adjusted Benefit 


1,046 


1,229 


602 


743 


916 


Present value of 










• 


Foil Benefit 












^ No discount 
5% discount 


46,236 ' 


56 , 306 


25,520 


:»,i88 


36,116 


15,594 


18,518 


8,871 


'12,331 


13,586 


10% discount 


7,972 


9,270 


4,655/ 


6,809 


Z,447 


Total Benefit 




♦ 








Compulsory High School Education 








V 


Representative 












Individual 


$ 2,900 


$ 3,810 


$1,370 


$2,580 


$1,940 


National Program 


142.3 


76.0^. 


29.9 


8.1 


J 6.9 


(Billions)^ 


(120.9) 








Compulsory College 


Education 










Representative 
Individual 












4,040 


4,910 


2,200 


?,430 


3,380 


* " c 

National Program 


428.5 


194. r 


103.7 


15.1 


19.9 


(Billions) 


(332.8) 






1 





^hese are marginal private benefits of one additional year of school, 
b ' 

The t6tal benefits given for a representative individual are computed by 

I (dY/dXi) f (Xi|Xi <m)^ dXi . where f (Xi/Xj <m) is the conditional distribution 
^ o : 

o|l individualjS by educational level, and m is either 12 or 16, corresponding to 
high school and college graduation respectively. 

The national program b^n^fits are computed by multiplying the representative 
individual benefits by^he corresponding total numbers of individuals (age 25 and 
• over) completing l^ss than high school or college education for 1970 taken from ^ 
Statistical Abstract of the United States 19J2, No. 168," p, 112. Figures in * 
parentheses for total samples are derived 'by summing the benefits for all four 
subsamples. 
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. TABLE 5.9 

ALTERNATIVE MEASURES OF BENEFITS OF READING C(^ETENCE 



White 



Black 





To^ 


Male 


Female * 


Male 


r 6iua i. p 


Marginal Benefit 










V 


Partial Benefit 


$ 172 


$ 375 


$ 12 


$ 187 


$ -341 


Full Benefit 


172 


375 


12 


'187 


. -341' 


Wage Effect 


185, 


356 


72 


66 


- -95 


Hour Effect 


-13 


19 


-60 


121 


■ -246 


Adjusted Benefit 












Present value of 








• 




Full Benefit 


$ 206 


$ 369 


1 90 


$ 71 


. $ -108 


No discount 


.8,267 


17,606 


. 803 


8,956 


-16,357 


5% discpunt 


, 3,^24 


6., 830 


384 ' 


3,385 


-6,359 


10% .discount 


1,832 


' 3,j848 ' 


249 


1,876 


-3,604 



II. Total Benefit 

Low Reading Target (Standardized reading score 
Representative 

. $ 161 



Individual 
National Program 
(Millions)'' 



$ 323 
2,002 



-1) 
$ 12 
71 



2,552 
(1,809) 

High Reading Target (Standardized reading score = 0) 
•Representative 

Individuals 163 332 12 

National Program % 
(Millions)t' 7,216 6,004 237 

(5,476) 



$ 273 
609 

34'p 

I 

1,098 



$ -392 
-873 

-490 
-1,863^ 



The total" benefits given for. a representative individual are computed by 

f (dY/dX2) f (X2(X2 < m)dX2 where f(X2/X2<m) is the conditional distribution 

of individuals by standardized reading score, and m is either -1 or zero, 
corresponding to a low or high target compensatory reading program. 



The national program benefits are' Computed by multiplying the representative 
individual benefits by the corresponding estimated numberV of individuals whose 



reading competence, measured by standardized scores, are 



-1 or zero, using 



the frequency distributions of 1972 National Reading Survey a^ population figures 
(age 25 and over) for 1970 obtained from Statisitical Abstract of the United States 
1972 , No. 168, p. 112. . Figures in parentheses for total sample are derived by 
summing the benefits for aLl four subsamples. 
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APPENDIX A: CORRELATION MATRICES' 



Tables A-1 through A-5 contain.the correlation matrices of the 
variables used in the study. Table A-1 is the correlation matrix 
\for the total sample; Tables A-2 to A-4 are the matrices for the 
four subsampTes, 
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APPENDIX B 

" ; ■ . 

* ' ■ - 

TESTS FOR LINEARITY-OF'ETTECTS BY USING DISCRETE VARIABLES 

The. purpose of this appendix is to^?eport some supplementary 
regression results of empirical eamings^^unctions using dummy 
variables to represent, different levels of schooling and reading - 
competence. In Section II, schooling and reading competence are 
represented by year^ of schooling and standardized scores in 
confuting enQ)irical earnings function, ii^licitly assuming that 
the effects of these t:wo variables (measured by the associated co- 
efficients) are the same at differed levels of schooling and 
reading competence. *This appendix summarizes the en^irical Results 
of an attempt ta verify the reasonability of this implicit assumption. 
Specifically, the schooling and reading scores variables in eqs. 
(1) and (2) are substituted by the following set of six dumny 
variables, four of them representing schooling "and the other two 
representing reac|||^ competence: 

School Dummy 1: 5 to 8 years of schooling = 1, otherwise = 0 

^ School Dummy 2: to 12 years of schoolipg = 1, otherwise = 0 

School Dummy 3; 13 to 16 ye^rs of schooling = 1, otherwise - 0 

,^ 

School Dummy 4: 16 and more yeart of schooling = 1, otherwise = 0 
Reading Dummy. L: Standardized scores below minus one* = 1, otherwise 
Reading Duminy H: Standardized scores above One = 1, otherwise = 0. 

The results of the en^irical .earnings function using these dummy 
' variables for schooling and reading con^etence are reported in 
Appendix Tables B-1 and B-2, using logarithmic values of earnings 
and earnings respectively as the dependent variables. These results 
are comparable with those reported in Tables 2 and 3 in the text. 
In general, the results shawn here arUsimilar to the corresponding 
results shown in Tables^ 2 3 of the text. It is important to 
note that while the assumption of constant schooling effect in eqs. 
(1) and (ly appears to be acceptable, the similar assumption for 
reading competence seems to be more questionable. This conclusion 
is derived from the observation that, the estimated coefficients 
pf the four school dummies seem to increase .at a r.oughly contant 
rate, as schooling level increases, and that the magnitudes of the ^ 
estimated coefficients of the two reading dummies (in terms of 
absolute values) are considerably different from each other. The 



results of Appendix 1ablB».B-l and B-2 generally show that indi- 
viduals Arith low reading )|cores tfan be expected to h^ave lower' 
earning^, jW.th a possible' exception of black females ^'''''^iliether 
individuals with high recKiing scores can be expected to h^e 
higher earnings, however, is not very conclusive from our Results, 
peWiaps because the reading \est instruments were designed only 
to rjfeveal functional reading ability. This result suggests that 
the economic benefit of i*^ding competence may tend to underestimate 
the true- effect. Fln^ll}i^^it may be pointed, out that while the 
school dummies are usually statistically significant, especially 
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APPENDIX TABLE B-1 
SUPPLEKENTARY' SEMI-LOG EARNINGS PUNCTION^'^ 



Explanatory 
Variable, r 



Total 



ttiite 



Male 



Female 



Black 



Male 



Female 



School Dummy 1 
School Dummy 2 
School Dummy 3 
School Dummy 4 
Reading Dirnmy L 
Reading Dummy H 
Expfelrience 
Exper ience-s quar e d^ 
Work Hours 
Father's Education 
Mother's Education 
Race 
•«Sex 

F 



0.3402 
(2.80) 

0.5585 
(4.63) 

0.8271 
(6.75) 

1.0789 
*.64) 

-0.1634 
(-5.-62) 

0.0360 
(L.37) 

0.0295 
(8.04) 

-o.ooo:i 

(-6.14li) 

- 0.8715 
(42.02) 

0.0021 
(0.73) 

0.0216 
(1.44) 

-0.1536 
(-3.91) 

-0.6131 
(-31.3 

0,599.0 

382.31 



0.7414 
(4.26) 


-0.3494 
(-1.33) 


(0.96) 


n 1 7A7 

(0.31) 


0.9500 
(5.46) 


' -0.1277 
(-0.49) 


0.4654 
(1.76) 


1.0214 
• (1.90) 


1.2156 
(6.93) • 


0.1007 
(0.38) 


f\ T C O O 

0.752O 

(2;46) 


1 ^ino. 
1 . j/Uo 

(2.88) 


1.4070 
(7.93) 


0.4815 . 
(1.8(^ 


0.9581 
(2.50) 


Z.OAlo 

(3.36) 


-O.lOD/ 
— *♦ . J o ^ 


t\ 1 7rkQ 
f-3 l2) 


(-1.28) 


0 0820 
(0.58) 


0.0432 
(1.44) 


0.0250 
(Q.51) . 


0.0075 
(0.03) 


-0.0420 
(-0.19) 


0.0462 
(10.49) 


0.0U7 
(1.73) 


4^117 
(0.66) 


-0 .0080 
• (-0.33) 


-0.0008 
(-8.30) 


-0-.0002 
. (-1.11) 


■ -0.0002 
*<-0.68) 


0.0002 
(0.32) 


0.7637 , 
(18.65) 


0.9051. 
(33,31) ^ 


0.8574 
(6.13) 


0.6969 
(5.45) 


0.0028 
(0.83) 


. 0.0025 
(0.47) 


0.0209 
(1.02) 


0.0144 
(0.73) 


0.0046 
(1.23) 


0.0078 
(1.28) 


-9.0051 
-0.25 


-0.0511 
' (-2.35) 












0.5043 
118.19 



0.5199 
•9.32 



0.5181 
7.64 



a. The dependent variable is the log of the number of thousands of^ dollars of annual 

earnings. • '» 

b. t-i/alues are expressed in parentheses below parameter estimates. 



^ APP5M)IX TABLE B-2 

SUPPLD^TARY LINEAR EARNINGS FUNCTION 



Explanatory 
Variable y 



School D^iiimny 1, ? 

School VmmyuZ 
* 

School Dummy 3 

School Duanmy-^ 

Reading Dummy L 

Reading Dummy H 

Experience 

Expejii^nce-squared 

Work Hours 

Father *3 Education 

Mother's Education 

Rac« 

Sex 



Total 



White 



Black 



Male 



Female 



Male 



Female 







-2.0170 


> 

0.7079 


0.2265 


X0.62) 


(1.44) 


(-1.32) ' 


(0.37) 


(0 .09; 


2.6749 


4.9729 


-0.5910 


2.0993 


2:9907 


f2.55) 


(2.60) 


»-0.39) 


/I 1 O \ 

(1.12) 


(l.zo; 


^5.3913 


8.4228 


0.7696 


6.6739 


5.9279 


- (5.07) 


(4.37) 


(0.50) 


(3.07) 


(2.50) 


^ 7.9786 


10.9533 


3.4436 


6.0697 


7.73 , 


^ (7-^6) 


(5.62) 


(2.21) 


(2.22) 




^1.1352 


-1.4766 


-0.7607 


-0.6632 


0.9217 








/■_n Rs^ 




0.1523 




-0.2148 


-1. 7118 


0.2454 


<0.67) 




i.-U. /D) 




CO 26^^ 


0;3850 


0.5641 


0.1156 


■0.1J086 


-0.0146 


(12.10) 


(11.65) 


(2.93) 


(0.86) 


(-0.14) 


t0.0065 


-0.0095 


-0.0017 


-0.0017 


0.0006 


(■^^ 62") 


^-9.24) 


(-2.07) 


(-0.71) 


(0.26) 


3.8571 


5.4476l'i 


• 3.3853 


3.7299 


2.0408 


(21.42) 


(12.10) • 


(21.40) 


(3.75) 


(3.67) 


0.0421 


0.0429 


0.0437 


•p. 2102 


0.0867 


^1.70) 


(1.16) 


(1.401) 

« 


(1.44) 


(1.01) 


0.0002 


-0.0006 


0.0250 


-0.0605 


-0.1521 


:(0.01) 


(-0.02) 


(0.70) 


(-0.42) 


(-1.60) 


-1.7440 










(-5.12) 










-5.2478 






# _ _ _ 




(-30.91) 










\ 0.4812 


0.2825 


0.3427 


0.4529 


0.4660 


237.35^ 


65.94 


60.56 


■ 7.12 


6.20 













The depen^it variable Is, the number of thousands of 'dollars of annual earnings, 
b. t-values are expressed In^ parentheses below parameter estimates. 
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APPENDIX C 



t ^ SIMULTANEOUS LABOR-MARKET MODEL 

The "purpose of this appendix Is to supplement the anal^tsls of 
Section III by considering a simultaneous model of labor market 
relationships. The simultaneous model in this* appendix is different 
from the recursive model reported in the text mainly in allowing 
work hours to affect wage rate in wage determination function 
represented by eq. (3), i.e., Y ^ 0. In addition, for identifica- 
tion purpose, a new variable referred to as employment status is 
liitroduced Into eq. (3) as an additional eaq)lanatory variable. 
Thus eq. (3) "may be regarded as the inverse demand function for 
labor, and eq. (4) the supply function of labor. Because* both wage 
rate and Work hours are -endogenous in the simultaneous model, some 
simultaneous equation approach must be considered for estimating 
the parameters in eqs. (3) and (4). In this appendix, the .results 
of the Two-Stage Least Squares (TSLS) procedure -are presented in 
Appendix Tables C-1 and C-2 for the wage determination and work 
hours functions respectively. The results of the Ordinary Least 
Squares (OLS) procedure for the wage determination fxmction, not 
"^reported here, are in general very similar to those of the TSLS 
procedure presented in Appendix Table C-1. The results of the OLS 
procedure for the work hours function are identical with those 
shown in Table 5 in the text. - . 

The results reported in Appendix Table C-1 are obtained by 
restricting the cpefflclents associated with employment status to 
the corresponding estimates obtained in the first stage. These 
additional restrictions were Introduced because the predicted work 
hours were so highly correlated with employment status (^ull-tlme 
salaried workers or not) that the usual second stage computation 
In the TSLS procedure became infeasible due to singularity of a 
matrix to be Inverted. In Appendix ^able C-2, the coefficient of 
- schooling for black males was restricted to be zero, since the 
* corresponding estimate in the first stage is negative, contrary to . • 
the usual' expectation, and without such a restriction the compu- 
tation was not feasible also due to singularity. Aside from these 
restrictions which were Imposed only to avoid computat'lonal 
difficulties, the empirical results of Appendix Tables C-1 and C-2 
are obtained following the usual TSLS procedure. One of the reasons 
the recursive model was selected for discussion in the text is based 
on the fact that, while Hork hours seem to b^.a significant factor 
determinlftg wage rate for the whites, the same does not appear to 
be true for the blacks. In addition, as was just mentioned, the , 
^ introduction of an employment status variable for identification 
purpose resulted in comp«tatlonal difficulties* We thus present 
these simultaneous estimations only tentatively. 
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The empirical results of Appendix Table C-1 are similar to 
those of Table 4,- which did not include, employment status and 
predicted work hours as additional explanatory variables. The 
empirical results of Appendix Table C-2, however, are considerably 
different ^rom those of Table 5 in the text. Recall that, besides 
a minor restriction introduced on the parameter associated with 
schooling variable for black males, the only difference between 
Appendix Table C-2 and Table 5 is the use of observed wage rate 
or predicted wage rate as an explanatory variable. As Appendix 
Table C-2 shows, the use of predicted wage i^ate has in general 
increased the goodness-of-f it considerably, Wxcept for black males. 
In fact, all coefficients in the work hours functions for white 
males, white females and black females are highly statistically 
significant, except Work experience for black females. In general, 
the effects of schooling, reading and -work experience all appear 
tb be much stronger than those of the OLS estimates employed for 
the Recursive model as shown in. Table 5. In particular, the effects 
of reading and work hoUrs are highly significantly positive for 
white males and white females, but negative for black females. 
The estimated effects of father '5 education and mother's education 
on wort hours are very different from those .of \the OLS estimates. 



APPENDIX TABLE C-l' ' 

# / 



REGRESSIO'H RESULTS OF WAGE DETERMINATION FUNCTION * (TSLS)- 



Explanatory 
Variable 


Total 


White 

Male 


• 

"Female 


Black 

/* 

Male Female 


'Sbhoc^iing 


0.5758 
(17.08) 


0.6545 
(14.45) 


0.3770 
(6.34) 


0.3696 
(3.97) 


0.4559. 
(7.24) 


Reading 


0.0995 
(1.13) 


0.1909 
(1.48) 


0.0353 
(0.25) 


0.0519 
(0^36) 


-0.0872 
(-0.70) 


Experience 

< 


0.2461 
(8.25) 


0 . 36 4 8 
(8.34) 


0.1272 
(2.75) 


0.0671 
(0.98) 


0.0153 
(0.26) 


Exper ienc e * S quar ed 


-0.0041 
(-6.53) 


-0.0061 
• (-6.71) 


-0.0019 
(-1.97) 


-0.0009 
(-0.71) 


-0.0002 
(-a. 16) 


Father's Education 


-0.0248 
(-1.03) 


-0.0500 
(-1.48 


■ 0.'0235 
(0.62) 


' 0.0641 
(0.81) 


0.0506 
(1.06) 


Hother*s Education 


-0.0505 
(-l.«5) 


-O.0883 
(-2.33) 


0.0425 
(0.98) 


-0.0704 
(-o!85) 


-0.1439 
(-2.65) 


QipxoyiBenc ^cacus 


(b) 


-0.2392 
(b) 


-1.5554 
(b) 


-0.7422 
(b) 


0.1926 
(b) 


Work Hours 


-2.5813 ' 
(-9.76) 


-4.6021 
(-5.70) 


(-9.91) 


-0.7307 
(-1.25) 


-0.3364 
(-0.95) 


Race 


-1.06 35 
(-3.21) 











Sex 


-3. 3083 
(-18.88) 










Coostant 


2.1277 
(2.84) 


4'. 2151 
(2.54)^ 


1.5366 
(1.52) 


0.7638 
(0.46) 


-1.4445 
(-1.21) 


2 

R 


0.1953 


0.1597 


0'.1225 


0.2630 


^ 0.4461 

• 


F 


89.83 


50.11 


25*56 


5.03 


9.45 ■ 



^t*values are placed in parentheaes below the paraaetet estimates.^ 



These estimates were restricted to the given value to avoid aulticollinearity. 



APPENDIX TABLE C-2. 



.REGRESSION RESULTS OF WORK HOURS FUNCTION ^ (TSLS) 



Explanatory^ 
Variable 



Total 



White 



Male 



Female 



Black 



Male 



Female 



Schooling 

Reading 

Experience 

Experience-Squared 
Father's Education 

Mother's Education 

Other Income 



Wage 

(predicted) 
Race 



Sex 



0.3680 
(47.91> 

0.0718 
(10.60) 

0.1493 
(41.83) 

-0.O025 
(-37.49) 

0.0237 
(-12.70) 

-0.0355 
(-16.29) 

0.0336 
(38. 76) 

• -0.7055 
(-50.30) 

-0.6599 
(-23.31) 

-2.3348 
(-55.63) 



0.1475 
(23.01) 

0.0573 
(8.55) 

0.0839 
(23.99) 

-0.0015 
(-22.28) 

-0-0171 
(-9.33) 

-0.0240 
(-11.26) 

0.0217 
(21.98) 

-0.2611 
(-25.29) 



0.4290 
(38.59) 

0.0375 
(2.81) 

0.1421 
(26.19) 

-0.0022 
(-21.06) 

0.0433 
(11.66) 

0.0.628 
. (14,73) 

0.0155 
(15.84) 

-1.3070 
(-43.02) 



(b) 



-0.7554 
(13.43) 



0.0298 -0.1750 
(0.99) (-6.68) 



-0.0022 
(0.17) 

O.C(001 
(0.23; 

0.0314 
a. 84-) 

'0.0067 
(0.44)'* 

. 0.0069 
(0.96) 

-0.0156 
(0.26) 



O.OOIL 
(0.09) 

. 0.0002 
(0.67) 

0.0443 
(4.41) 

-0.1788 
(-9.59) 

0.0642 

(ll;05) 

-2.0021 
(-13.65) 



Constant 
2 

R 
F 



0.4732 
(9.24) 

0.5020' 
335.65 



1.0731 
(21.52) 

0.2751 
87.54- 



-1.6306 
(-14.46) 

0-5994 
239.55 



1.5378 -0.8942 
(5.49) (-3.23) 



0.1484 
2.46 



0.7381 
28.60 



t-values are placed in parentheses below the parameter estimates. 



This parameter vas restricted to be zero. 



APPENDIX D , 
SIMULTANEOUS MODEL OF EDUCATIONAL ACHIEVEMENTS 



Itj Section IV of the text, the empirical results of a re- ^ 
cursiye model of educational achievements have been examined. The 
purpose of this Appendix is to supplement those resxilts by examining 
the empirical results of a simultaneous model in which not only 
schooling is .assumed to affect reading but also reading is assumed 
to affejt schooling* In order to identify eqs. (5) and- (6), in 
eq. (5) we replaced father* s education and mother's education by 
a single variable Constructed by sunning the years of schooling of 
both parents, i.e., restricting the parameters associated with ► 
father's education and mother's education to be«0lle same. In 
addition, in eq. (6), we assumed that father's education does not 
affect reading for total sample and subsan^les of white males and 
white females but that mother's education does. For black males 
and females, however, we assume^ father's education, rather tlian 
mother's education, affects reading. These restrictions, imposed 
for identification* purposes, are largely based on empirical 
results and are admittedly somewhat arbitrary. 

The empirical res.ults of the Two Stage Least Squares (TSLS) 
estimation of ^he simultaneous model o*f educational achivements are 
presented in Appendix Tables D-1 and D-2 for 'the determinants of 
schooling and reading respectively. The corresponding results of 
the Ordinary Least Squares (OLS) estimation are not reported here. 
The most striking differences between these^two sets of estimated 
values using TSLS and OLS respectively are the coefficients associated 
with schooling in eq. (6), representing the interaction between 
these two variables. While these coefficients ar6 hig^ily signifi- 
cant when the observed reading scores and. schooling level wei'e used 
in eq^. (5) and (6), a^ in the OLS procedure, the same is not 
generally trtie when the"~predicted reading scores and schooling 
level were used instead, as*in the TSLS procedure (Appendix Tables 
D-1 and D-2) . • . ' 

Among the determinants of schooling examined in Appendix Table 
D-1, father '-S and mother's education clearly has a significantly 
positive effect for all subsamples. The effect of alge is generally 
negative, reflecting a general trend of increasing educational 
level, with a possible exception of black females.. The effect of 
reading on Schooling is generally not significant and mostly turns 
out to be negative, possibly because of the oversimplified structure 
of our simultaneous model. Among the determinants of readirlg scores 
considered in Appendix Table D-2,. mother's education is statistically 
significant for whites and father's education is for blacks. The 



-128- 



effect of age> on reading is negative for whites and positive ^f or 
blacks^- but, statistically significant oniy for white females. The 
effect of schooling on reading is generally , positive, except for 
black females* However, only the estimated coeffigients fo^ the 
total sample aaid the subsample of white males are statistically 
significant. In general, our results do indicate that the recursive 
model considered in >the text (X-O, y«0) is more .plausible than the 
other type' of recursive modjel (Xf^O, y«0) . Finally, the effects ofe- 
race and sex are obvious eitjher from the resultiB of dummy variables 
or from conq)arisons among, corresponding regressions obtained 'for 
various subsamples. 
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APPENDIX TABLE D-1 



REGRESSION RESULTS OF DETERMINANTS OF SCHOOLING (TSLS) . 



* • • 

/' 


. Explanatory, 
Variable 


Total 


Male 


White 

Female 


Black 
Male Female 


' / • 

/ " 


Father's ^ucation ^ 


. 0.1719 
' (5.-59) ^ 


0,2109 
(5.87) 


^ 0.1610 
(5.91) 


0.4294 
(3.14) . 


0,2035 
(4.07) 




Mother's Education ^ 


0.1719 " 
(5.59) 

1 

0.241Z 
(0.31) 


0.ZTD9 
(5.87) 


r 0.1610 

'(5.91) 


0.4294 
(3.14) 


0.2035 
(4.07) 




Reading' 
(predicted) 


. -1.0032 
C-l.lA) 


0.9781 
(1.23) 


-1.6703 
(-1.45) 


-0.8449 
(-1.40) 






-0.0137 
(-2.27) 


-0;0235 ' :-0.0018 
(-2.91) (-a. 23) 


-0.0799 
(-3.33) 


0.0366 
(1M2) 


y 


Race 

• 


.-0.6247 
(-0,80) 






0 






Sex • 


-0.2613 ' 
(-2.96) 












Constant 


10.3198 ■ 
(24.33) 


10.0978 
(19.26) 
• 


9.6922 
(24.75) 


5.1837 
ii^.l9) 


6.8140 
(3.94) 



:2 



0.2402 
210.80 f, 



■0.1947 
149.09 . 



0.3090 
191.6-5 



_t).4640 
'29.62 ' 



0.1883 
6.66 



t-value6 are placed in parentheses below the parameter estimates. 

b ' - . . ^ 

These estimates were -constrained to have the same magnitude for father's 

education as for mother's education. - ' 
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APPENDIX TABLE D-2 



REGRESSION RESULTS OF DETERMINANTS OF READING (TSLS) 



^Ixplanatory 
* Variable 



■ Total 



White 



Hale 



Female 



Black 



Male 



Female 



Father's Education^, 



Mother's Education 



Schooling 
(predicted) 



' 0.0321 
(3.32) 

0.1335 
(4.79) 



0.0458 

, (4. 17) 

- 0.1082 
(3.23) 



0.0424 
(2.58) 

0.0675 
(1.53) 



0.1378 0.1900 
(1.83) (4.05) 



0.0758 .-0.2963 
(0.52) (-1.76) 



Age 



4 

-0.0029 
(-1.70) 



-0.0029 -0.0056 0.0107 0.0159 

C-1.27) (f-2.30^ (0.54^ (l.lO) ♦ 



R«ice 



Sex 



Constant 



-0.8755 
(U.99) 

0.0518 
(1.57) 

-1.8635 
(-5.96) 



-1.6597 
(-4.21) 



-0.9674 
(-2.12) 



-3.4751 
(-1.95) 



xO.7087 
(0.41) 



R 
F 



0.1545 



121.87 



0.1114 



0.0925 0.1702 " 0.1986 

43.71 ' 7.02 7.12 



^t-values are placed in parentheses below the parameter estimates. 

'^Father's education was -constrained to have 9 zero coefficient for the total 
lianple and 'the white subsan^les. 

Slother's education was constrained to have a zero coefficient for the black 
subsamples . 
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